-- Logs begin at Thu 2022-07-14 19:35:54 UTC, end at Thu 2022-07-14 20:52:52 UTC. -- Jul 14 20:25:03.176440 dv-cinder-799871-32-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 20:25:03.184624 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 20:25:03.186653 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 20:25:03 2022] *** Jul 14 20:25:03.186653 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 20:25:03.186653 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 20:25:03.186653 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: nodename: dv-cinder-799871-32-iscsi Jul 14 20:25:03.186653 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: machine: x86_64 Jul 14 20:25:03.186653 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: clock source: unix Jul 14 20:25:03.186653 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: pcre jit disabled Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: detected number of CPU cores: 4 Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: current working directory: / Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: detected binary path: /usr/bin/uwsgi-core Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: your processes number limit is 47680 Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: your memory page size is 4096 bytes Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: detected max file descriptor number: 2048 Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: lock engine: pthread robust mutexes Jul 14 20:25:03.187170 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: thunder lock: enabled Jul 14 20:25:03.192320 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 20:25:03.192320 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 20:25:03.228780 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: Python main interpreter initialized at 0x561e185119c0 Jul 14 20:25:03.228780 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: python threads support enabled Jul 14 20:25:03.228780 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: your server socket listen backlog is limited to 100 connections Jul 14 20:25:03.228780 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: your mercy for graceful operations on workers is 90 seconds Jul 14 20:25:03.229277 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 20:25:03.229277 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: *** Operational MODE: preforking *** Jul 14 20:25:03.229529 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: *** uWSGI is running in multiple interpreter mode *** Jul 14 20:25:03.229529 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: spawned uWSGI master process (pid: 103359) Jul 14 20:25:03.229734 dv-cinder-799871-32-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 20:25:03.233175 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 1 (pid: 103360, cores: 1) Jul 14 20:25:03.233175 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 2 (pid: 103361, cores: 1) Jul 14 20:25:03.233175 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 20:25:03.898147 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 20:25:03.902672 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 20:25:05.015184 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:25:05.015184 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jul 14 20:25:05.015866 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:25:05.015866 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jul 14 20:25:05.016304 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:25:05.016304 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jul 14 20:25:05.016450 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:25:05.016450 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jul 14 20:25:07.511998 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 20:25:07.512703 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 20:25:07.512831 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 20:25:07.513131 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 20:25:07.513386 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 20:25:07.513771 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.514090 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.514408 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.514728 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.515082 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.515397 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.515721 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.516038 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.516366 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.516622 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.516937 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.517260 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-32-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.517846 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.518153 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.518461 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.518741 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 20:25:07.519197 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.519197 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.519404 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 20:25:07.519542 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.519686 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.519902 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 20:25:07.520187 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.520365 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 20:25:07.520615 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.520819 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 20:25:07.521000 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.521214 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.521373 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.521551 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.521859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.521982 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.522162 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.522432 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.522588 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.522812 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.522981 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.523169 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.523458 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.523663 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.523897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-32-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.524053 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.524215 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.524413 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.524511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.524830 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.524930 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.525254 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.525374 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.525561 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.525753 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.525909 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.526177 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.526328 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.526533 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.526736 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-32-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.526920 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.527127 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.527363 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.527521 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.527754 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.527902 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.528060 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.528329 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.528476 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.528649 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.528812 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.528962 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.529257 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.529375 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.529560 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.529743 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.529913 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.530107 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.530325 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.530492 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.530719 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.531060 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.531263 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.531414 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.531576 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.531725 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.531912 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.532106 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.532359 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.532570 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.532708 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.532840 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.533061 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.533197 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.533330 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.533527 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.533728 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.533893 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.534084 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.534289 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.534444 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.534578 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.534718 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.534851 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.535027 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.535118 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.535392 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.535512 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.535704 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.535933 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-32-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.536019 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.536308 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.536406 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.536708 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.536802 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.536960 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.537263 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.537352 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.537601 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.537907 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.537998 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.538247 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.538388 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.538567 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.538818 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.539023 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.539239 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.539416 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.539546 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.539852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.539951 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.540181 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.540344 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.540493 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.540807 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.540969 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.541136 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.541341 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.541505 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.541653 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.541883 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.542052 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.542221 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.542436 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.542592 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.542809 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.543005 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.543177 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.543427 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.543578 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.543721 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.543987 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.544146 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.544301 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.544535 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.544700 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.544875 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.545061 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.545222 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.545475 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.545628 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.545772 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.545982 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.546135 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.546384 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.546561 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.546713 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.546993 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.547189 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.547337 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.547580 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.547740 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.547899 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.548083 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.548205 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.548451 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.548540 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.548814 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.549069 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.549182 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.549429 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.549571 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.549713 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.550006 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.550167 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.550333 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.550484 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.550623 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.550871 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.551068 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.551238 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.551442 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.551600 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.551815 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.551985 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.552134 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.552412 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.552568 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.552717 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.552946 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.553138 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.553367 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.553511 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.554157 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.554414 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.554578 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.554744 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.555040 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.555209 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.555363 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.555595 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.555761 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.555950 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.556147 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.556298 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.556561 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.556713 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.556901 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.557187 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.557340 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.557565 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.557869 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.558044 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.558230 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.558386 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.558534 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.558669 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.558801 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.559094 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.559264 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.559442 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.559666 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.559816 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.559960 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.560059 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.560356 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.560470 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.560663 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.560821 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.560990 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.561299 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.561476 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.561628 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.561827 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.561983 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.562222 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.562388 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.562536 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.562820 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.563046 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.563196 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.563413 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.563577 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.563777 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.563927 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.564073 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.564321 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.564487 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.564736 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.564887 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.565033 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.565296 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.565466 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.565675 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.565824 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.565967 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.566277 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.566430 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.566583 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.566848 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.567059 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.567264 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.567423 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.567579 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.567820 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.567990 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.568135 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.568377 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.568533 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.568697 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.568997 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.569190 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.569979 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.570193 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.570409 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.570607 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.570848 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.570848 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.571259 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.571420 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.571557 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.571696 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.571859 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.572001 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.572141 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.572327 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.572476 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.572608 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.572790 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.572993 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.573205 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.573352 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.573499 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.573745 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.573904 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.574106 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.574234 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.574436 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.574580 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.574732 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.575033 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.575184 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.575374 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.575531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.575675 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.575911 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.576084 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.576277 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.576420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.576564 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.576781 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.576929 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.577196 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.577399 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.577544 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.577696 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.577840 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.578072 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.578218 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.578379 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.578515 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.578679 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.579009 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.579181 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.579325 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.579472 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.579616 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.579879 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.580031 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.580251 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.580383 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.580539 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.580751 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.580895 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.581101 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.581263 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.581457 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.581650 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.581809 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.582031 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.582201 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.582347 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.582487 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.582639 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.582901 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.583126 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.583296 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.583454 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.583613 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.583817 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.583990 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.584212 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.584376 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.584523 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.584679 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.584873 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.585085 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.585233 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.585406 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.585549 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.585693 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.585954 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.586104 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.586274 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.586415 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.586558 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.586808 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.586986 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.587196 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.587365 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.587558 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.587716 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:25:07.587860 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.588081 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.588227 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.588386 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.588643 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.588858 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.589002 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.589168 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.589318 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.589599 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.589750 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.589944 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.590085 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.590267 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.590500 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.590714 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.590861 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.591040 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.591208 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.591418 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.591632 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.591791 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.591960 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.592111 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.592437 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.592603 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.592917 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.593071 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.593215 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.593388 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.593500 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.593732 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.593896 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.594054 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.594281 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.594421 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.594705 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.594822 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.595065 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.595254 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.595488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.595774 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.595932 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.596136 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.596363 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.596517 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.596755 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.596907 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.597062 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.597294 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.597457 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.597656 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.597864 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.598022 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.598239 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.598411 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.598560 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.598714 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.598853 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.599181 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.599346 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.599490 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.599673 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.599822 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.600085 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.600236 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.600390 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.600605 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.600746 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.601023 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.601166 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.601350 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.601500 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.601684 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.601993 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.602156 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.602291 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.602438 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.602598 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.602876 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.603076 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.603201 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.603495 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.603696 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.603854 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.604055 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.604214 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.604382 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.604593 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.604764 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.604974 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.605128 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.605288 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.605573 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.605719 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.605885 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.606205 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.606356 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.606516 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.606792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.606976 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.607140 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.607355 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.607524 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.607719 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.607952 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.608125 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.608349 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.608582 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.608774 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.608913 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.609005 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.609168 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.609330 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.609479 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.609704 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.609884 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.610068 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.610259 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.610412 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.610696 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.610851 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.611042 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.611298 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.611469 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.611612 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.611851 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.612009 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.612215 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.612374 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.612535 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.612820 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.612971 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.613131 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.613381 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.613598 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.613814 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.614017 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.614224 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.614445 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.614613 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.614769 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.614903 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.614903 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.615153 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.615238 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.615428 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.615536 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.615837 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.615934 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.616807 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.616917 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.617155 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.617314 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.617460 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.617674 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.617769 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.618076 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.618258 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.618583 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.618756 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.619002 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.619133 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.619320 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.619597 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.619702 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.619947 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.620046 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.620264 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.620453 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.620593 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.620872 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.620959 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.621247 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.621349 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.621557 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.621724 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.621864 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.622168 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.622258 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.622468 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.622588 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.622778 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.623058 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.623149 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.623412 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.623502 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.623723 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.623967 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.624079 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.624315 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.624422 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.624615 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.624825 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.625001 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.625209 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.625355 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.625520 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.625720 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.625833 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.626115 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.626242 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.626423 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.626694 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.626859 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.627074 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.627383 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.627575 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.627712 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.628004 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.628156 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.628416 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.628582 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.628717 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.628978 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.629139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.629541 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.629707 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.629839 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.629969 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.630243 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.630394 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.630527 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.630807 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.631021 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.631163 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.631290 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.631439 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.631792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.632459 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.632594 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.633146 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.633295 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.633425 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.633576 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.633707 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.634201 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.634348 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.634478 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.634621 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.634761 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.634891 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.635077 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.635209 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.635560 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.635721 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.635855 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.636110 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.636256 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.636385 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.636659 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.636827 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.636969 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.637222 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.637368 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.637510 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.637763 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.637939 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.638080 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.638464 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.638690 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.638690 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.639000 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.639139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.639287 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.639596 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.639817 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.639965 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.640124 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.640280 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.640472 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.640672 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.640823 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.641060 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.641225 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.641371 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.641650 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.641802 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.641947 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.642221 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.642389 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.642792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.643045 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.643217 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.643421 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.643599 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.643744 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.644000 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.644232 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.644379 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.644593 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.644758 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.644904 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.645150 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.645305 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.645448 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.645680 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.645853 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.646019 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.646235 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.646388 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.646630 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.646778 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.646964 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.647246 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.647421 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.647567 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.647821 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.647997 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.648189 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.648377 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.648529 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.648838 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.648992 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.649153 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.649382 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.649536 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.649738 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.649945 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.650104 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.650340 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.650511 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.650658 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.650996 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.651185 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.651327 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.651562 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.651755 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.651919 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.652156 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.652316 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.652475 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.652758 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.652909 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.653054 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.653282 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.653505 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.653665 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.653832 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.653995 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.654264 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.654474 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.654621 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.654854 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.655049 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.655197 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.655406 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.655561 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.655767 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.656076 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.656253 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.656398 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.656647 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.656799 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.656974 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.657287 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.657442 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.657592 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.657851 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.658004 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.658162 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.658381 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.658532 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.658754 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.658992 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.659146 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.659404 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.659555 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.659699 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.659969 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.660122 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.660268 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.660494 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.660646 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.660862 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.661011 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.661301 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.661510 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.661783 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.661931 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.662074 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.662218 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.662476 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.662650 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.662795 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.665732 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.665951 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.666104 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.666257 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.666424 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.666424 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.666700 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.666846 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.667179 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.667330 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.667330 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.667615 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.667761 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.667907 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668053 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668053 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668332 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668478 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668478 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668750 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668894 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.668894 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.669192 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.669338 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.669483 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.669626 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.669626 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.669901 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.670057 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.670057 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.670384 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.670507 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.670650 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.670813 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.670813 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.671100 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.671245 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.671245 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.671511 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.671675 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.671675 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.671942 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.672084 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.672084 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.672360 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.672505 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.672505 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.672764 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.672907 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.673050 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.673205 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.673205 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.673468 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.673674 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.673674 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.673940 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.674104 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.674246 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.674387 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.674532 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.674829 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.675049 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.675268 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.675415 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.675570 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.675876 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.676030 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.676191 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.676405 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.676569 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.676774 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.676921 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.677066 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.677370 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.677523 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.677665 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.677931 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.678082 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.678265 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.678467 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.679189 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.679426 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.679587 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.679745 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.680023 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.680188 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.680386 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.680574 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.680724 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.680917 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.681116 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.681266 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.681536 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.681845 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.682017 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.682161 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.682359 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.682513 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.682748 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.682894 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.683075 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.683374 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.683546 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.683758 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.683905 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.684059 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.684290 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.684437 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.684603 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.684896 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.685066 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.685210 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.685422 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.685587 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.685825 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.686031 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.686176 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.686432 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.686598 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.686755 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.687011 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.687165 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.687399 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.687566 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.687713 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.687989 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.688151 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.688308 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.688528 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.688680 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.688872 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.689035 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.689180 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.689465 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.689615 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.689759 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.690030 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.690192 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.690328 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.690671 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.691014 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.691164 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.691330 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.691527 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.691697 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.691892 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.692074 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.692225 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.692427 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.692654 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.692827 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.693058 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.693207 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.693378 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.693658 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.693861 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.694051 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.694792 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.695017 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.695185 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.695546 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.695698 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.695842 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.696149 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.696320 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.696583 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.696739 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.696940 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.697088 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.697278 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.697443 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.697666 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.697887 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.698052 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.698273 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.698419 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.698561 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.698877 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.699095 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.699473 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.699628 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.699863 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.700022 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.700179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.700469 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.700624 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.700769 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.700993 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.701159 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.701371 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.701532 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.701677 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.701977 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.702127 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.702269 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.702507 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.702660 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.702891 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.703125 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.703270 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.703543 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.703712 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.703858 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.704119 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.704275 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.704484 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.704681 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.704830 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.705099 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.705310 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.705468 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.705755 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.705919 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.706065 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.706362 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.706512 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.706670 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.706984 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.707158 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.707303 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.707539 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.707692 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.707891 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.708175 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.708340 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.708484 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.708792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.708966 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.709125 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.709399 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.709562 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.709709 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.710010 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.710167 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.710371 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.710628 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.710781 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.711062 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.711254 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.711406 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.711734 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.711891 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.712139 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.712298 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.712473 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.712747 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.712917 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.713130 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.713361 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.713527 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.713713 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.713899 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.714049 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.714337 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.714503 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.714660 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.714905 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.715147 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.715353 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.715494 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.715659 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.715847 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.715994 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.716138 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.716448 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.716603 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.716761 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.716976 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.717130 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.717448 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.717601 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.717899 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.718050 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.718206 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.718428 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.718580 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.718832 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.719032 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.719194 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.719439 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.719606 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.719751 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.719972 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.720140 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.720345 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.720494 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.720639 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.720951 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.721107 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.721273 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.721470 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.721634 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.721829 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.722004 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.722170 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.722421 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.722570 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.722713 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.723037 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.723194 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.723359 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.723571 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.723724 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.723939 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.724085 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.724240 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.724535 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.724686 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.724828 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.725055 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.725210 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.725428 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.725602 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.725735 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.726448 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.726563 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.726563 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.726710 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.726790 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.726880 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.727075 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.727260 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.727418 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.727528 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.727783 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.727880 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.728218 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.728406 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.728561 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.728760 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.728868 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.729074 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.729170 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.729393 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.729543 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.729709 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.729989 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.730150 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.730325 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.730510 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.730668 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.731058 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.731418 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.731516 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.731597 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.731831 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.732054 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.732223 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.732527 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.732744 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.732970 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.733219 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.733447 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.733656 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.733870 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.734080 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.734080 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.734491 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.734656 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.734656 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.734977 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.735127 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.735270 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.735435 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.735580 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.735774 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.735928 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.736074 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.736298 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.736452 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.736667 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.736799 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.736971 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.737258 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.737400 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.737545 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.737766 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.737905 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.738149 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.738283 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.738460 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.738755 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.738907 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.739137 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.739437 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.739596 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.739756 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.740081 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.740237 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.740486 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.740666 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.740820 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.741006 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.741776 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.741932 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.742144 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.742292 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.742471 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.742786 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.742977 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.743142 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.743402 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.743557 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.743832 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.743994 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.744198 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.744432 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.744587 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.744733 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.744981 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.745141 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.745360 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.745521 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.745666 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.745977 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.746186 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.746336 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.746569 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.746721 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.746930 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.747111 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.747275 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.747591 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.747743 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.747887 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.748120 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.748292 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.748473 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.748633 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.748779 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.749087 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.749238 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.749397 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.749634 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.749788 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.749964 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.750171 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.750324 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.750562 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.750711 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.750858 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.751184 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.751337 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.751481 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.751734 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.751888 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.752064 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.752286 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.752438 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.752657 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.752836 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.752983 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.753247 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.753398 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.753584 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.753808 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.753962 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.754122 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.754337 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.754491 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.754695 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.754880 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.755082 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.755300 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.755460 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.755634 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.755925 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.756092 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.756266 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.756465 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.756620 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.757454 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.757619 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.757776 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.758029 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.758184 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.758378 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.758548 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.758714 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.759036 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.759190 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.759336 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.759580 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.759747 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.759959 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.760109 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.760266 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.760564 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.760728 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.760884 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.761115 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.761267 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.761456 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.761648 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.761798 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.762168 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.762324 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.762470 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.762647 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.762799 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.763033 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.763276 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.763431 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.763660 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.763808 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.763953 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.764255 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.764423 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.764564 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.764872 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.765023 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.765183 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.765460 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.765619 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.765776 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.766006 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.766265 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.766416 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.766572 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.766729 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.766964 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.767130 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.767285 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.767802 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.767971 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.768172 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.768348 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.768499 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.768790 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.768954 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.769111 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.769335 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.769490 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.769747 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.769998 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.770180 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.770400 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.770550 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.770693 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.771031 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.771184 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.771347 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.771564 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 20:25:07.771714 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.772021 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.773136 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.773546 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.773973 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.774369 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.774770 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.775240 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.775658 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.776065 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.776483 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.777007 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.777414 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.777812 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.778326 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.778736 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.779179 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.779845 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.784777 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.785851 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.785851 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.786172 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.786511 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.787137 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.787721 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.789241 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.789850 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.790419 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.791055 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.791652 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.792253 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.792772 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.793360 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.793916 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.794486 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.795121 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.795670 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.796190 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.796526 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.797033 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.797462 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.797781 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.798117 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.798441 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.798875 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.799113 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.799441 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.799763 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.800072 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.800402 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.800713 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.801017 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.801325 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.801629 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.801978 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.802283 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.802604 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.802969 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.803305 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.803637 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.803973 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.804299 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.804617 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.804935 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.805260 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.805560 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.805868 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.806178 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.806478 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.806784 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.807113 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.807417 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.807714 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.808015 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.808317 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.808641 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.808948 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.809268 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.809571 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.809872 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.810180 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.810480 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.810824 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.811158 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.811495 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.811818 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.812136 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.812468 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.812778 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.813102 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.813419 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.813736 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.814047 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.814363 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.814676 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.815020 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.815335 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.815646 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.815960 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.816273 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.816588 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.817167 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.817496 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.817809 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.818119 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.818428 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.818742 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.819076 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.819436 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.819746 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.820060 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.820370 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.820705 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.821026 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.821353 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.821695 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.822016 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.822330 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.822642 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.822983 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.823356 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.823678 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.823979 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.824291 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.824605 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.824915 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.825223 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.825536 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.825847 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.826155 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.826465 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.826776 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.827118 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.827437 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.827766 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.828104 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.828425 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.828735 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.829047 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.829359 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.829939 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.830252 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.830584 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.830905 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.831264 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.831580 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.831897 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.832233 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.832532 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.832840 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.833166 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.833450 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.833750 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.834082 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.834387 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.834486 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Registered counter for database nova_api Jul 14 20:25:07.834688 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.835582 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.835891 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.836480 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.836830 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.837197 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.837470 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.837790 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.838108 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.838412 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.838731 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.839057 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.839361 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.839674 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.839987 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.840286 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.840587 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.841023 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.841335 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.841637 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.841943 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.842245 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.842572 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.842879 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.843212 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.843519 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.843821 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.844330 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.844438 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.844708 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.845010 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.845320 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.845620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.845932 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.846234 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.846542 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.846841 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.847189 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.847546 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.847877 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.848184 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.848485 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.848804 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.849112 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.849436 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.849754 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.850061 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.850448 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.851334 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.851930 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.852269 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.852589 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.852929 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.853265 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.853573 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.853875 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.854187 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.854505 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.854822 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.855159 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.855465 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.855772 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.856078 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.856387 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.856692 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.857019 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.857306 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.857609 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.857913 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.858220 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.858522 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.858836 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.859213 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.859538 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.859854 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.860165 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.860477 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.860782 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.861088 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.861394 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.861698 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.862016 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.862346 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.862656 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.862987 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.863428 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.863735 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.864055 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.864379 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.864745 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.864997 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.865319 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.865628 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.865946 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.866376 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.866710 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.867072 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.867408 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.867735 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.868039 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.868343 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.868644 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.868950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.869268 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.869581 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.869884 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.870185 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.870493 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.870796 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.871147 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.871451 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.871752 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.872050 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.872351 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.872650 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.872953 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.873255 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.873561 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.873858 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.874162 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.874466 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.874788 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.875095 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.875399 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.875816 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.876159 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.876495 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.876807 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.877128 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.877449 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.877759 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.878065 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.878768 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.879128 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.879456 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.879774 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.880108 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.880418 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.880726 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.881033 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.881340 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.882182 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.882507 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.882846 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.883215 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.883525 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.883849 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.884170 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.884489 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.884810 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.885121 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.885450 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.885758 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.886073 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.886374 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.886682 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.887016 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.887330 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.887636 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.887945 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.888258 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.888571 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.888898 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.889221 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.889527 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.889847 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.890173 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.890529 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.890871 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.891389 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.891720 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.892096 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.892480 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.893106 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:25:07.893350 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 20:25:07.948838 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:07.955658 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:07.958029 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Registered counter for database nova_api Jul 14 20:25:08.014915 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.context [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e48e7cb-a586-40dc-b694-2536a52d42ed(cell1) {{(pid=103361) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 20:25:08.019551 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:25:08.021196 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:25:08.022084 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:25:08.024989 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:25:08.027144 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Registered counter for database nova_cell0 Jul 14 20:25:08.031658 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Registered counter for database nova_cell1 Jul 14 20:25:08.041109 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:08.043775 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:08.050449 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:08.053656 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:08.069973 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:08.077454 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:08.134299 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.context [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e48e7cb-a586-40dc-b694-2536a52d42ed(cell1) {{(pid=103360) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 20:25:08.138353 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:25:08.139955 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:25:08.140759 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:25:08.143252 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:25:08.145555 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Registered counter for database nova_cell0 Jul 14 20:25:08.150535 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Registered counter for database nova_cell1 Jul 14 20:25:08.161822 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:08.162849 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:08.170293 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:08.171618 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:08.202775 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Registered counter for database nova_cell0 Jul 14 20:25:08.212476 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:08.217084 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:08.323594 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Registered counter for database nova_cell0 Jul 14 20:25:08.330801 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:25:08.335803 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:25:08.558859 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:25:08.566469 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:25:08.655717 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:25:08.664713 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:25:08.908108 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:25:08.914819 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:25:08.920448 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e185119c0 pid: 103361 (default app) Jul 14 20:25:08.922910 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:25:08.924170 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jul 14 20:25:08.924613 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Thu Jul 14 20:25:08 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:25:09.021405 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:25:09.028417 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-194be1eb-93e0-4519-a318-214cacf86e70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:25:09.033556 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e185119c0 pid: 103360 (default app) Jul 14 20:26:34.032113 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:34.033264 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 14 20:26:34.034894 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:26:34.061775 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:34.065157 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:34.069001 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:34.070994 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:35.365140 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ac297d8b-6194-4c49-844d-21400a0e6a62 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:35.425657 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ac297d8b-6194-4c49-844d-21400a0e6a62 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.374112 Jul 14 20:26:35.426703 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 14 20:26:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:26:38.170220 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:38.171305 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c579ce5f-e64d-44ca-a1a6-5675287183fa None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 14 20:26:38.171955 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:26:38.744162 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e530c439-40ac-454d-8699-6331c79bbc45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "disk": 1}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:38.763550 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:26:38.763550 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jul 14 20:26:38.795666 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-e530c439-40ac-454d-8699-6331c79bbc45 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.616698 Jul 14 20:26:38.796687 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:26:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:26:39.220893 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-feb64abe-8e70-4cfd-9aa4-d6a2956ae610 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:39.224452 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:26:39.224452 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jul 14 20:26:39.227623 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:39.228619 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:39.229634 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell1:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:39.230360 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:26:39.332515 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-feb64abe-8e70-4cfd-9aa4-d6a2956ae610 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.521636 Jul 14 20:26:39.333532 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 14 20:26:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:26:41.995816 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e530c439-40ac-454d-8699-6331c79bbc45 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:41.996886 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-e530c439-40ac-454d-8699-6331c79bbc45 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 14 20:26:41.997477 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:26:42.914901 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-0e16df8f-876f-4502-a42b-8890aa6671ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:42.952531 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:26:42.952531 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jul 14 20:26:42.981970 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-0e16df8f-876f-4502-a42b-8890aa6671ca admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.977773 Jul 14 20:26:42.982989 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:26:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:26:42.997979 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-47360766-ce59-4d31-9478-fe4c02b5c4ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:42.999640 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:26:42.999640 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jul 14 20:26:43.038433 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-47360766-ce59-4d31-9478-fe4c02b5c4ca admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044468 Jul 14 20:26:43.050216 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 14 20:26:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:26:45.770429 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-0e16df8f-876f-4502-a42b-8890aa6671ca admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:45.772279 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-0e16df8f-876f-4502-a42b-8890aa6671ca admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Jul 14 20:26:45.774212 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:26:46.448364 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-a7522334-5410-4685-8719-5715aada0ecb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:46.470967 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-a7522334-5410-4685-8719-5715aada0ecb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691207 Jul 14 20:26:46.472337 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:26:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:26:46.484788 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-3b3a8eea-1862-4f27-9dcf-135a5f76de10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:46.511401 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-3b3a8eea-1862-4f27-9dcf-135a5f76de10 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030354 Jul 14 20:26:46.512002 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 14 20:26:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:26:49.156040 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-a7522334-5410-4685-8719-5715aada0ecb admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:49.157897 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-a7522334-5410-4685-8719-5715aada0ecb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002601 Jul 14 20:26:49.158648 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:26:49.816320 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-773ec3f0-34e8-4ff8-b68f-e5147d94df7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:49.845924 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-773ec3f0-34e8-4ff8-b68f-e5147d94df7c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676275 Jul 14 20:26:49.848230 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:26:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:26:49.864231 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ca030855-4c59-4944-bcfd-9edc57e62687 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:49.895715 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ca030855-4c59-4944-bcfd-9edc57e62687 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037553 Jul 14 20:26:49.896661 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 14 20:26:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:26:52.524951 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-773ec3f0-34e8-4ff8-b68f-e5147d94df7c admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:52.527019 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-773ec3f0-34e8-4ff8-b68f-e5147d94df7c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jul 14 20:26:52.532139 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:52 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:26:53.085264 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-87b44d4f-b510-4dc7-9761-75dfe50c45b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:53.106994 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-87b44d4f-b510-4dc7-9761-75dfe50c45b7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.573815 Jul 14 20:26:53.114050 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:26:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:26:53.120579 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e2f320f2-76e7-4d83-8ef0-881ce5eef6cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:26:53.155676 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-e2f320f2-76e7-4d83-8ef0-881ce5eef6cb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038416 Jul 14 20:26:53.162073 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 14 20:26:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:26:56.614413 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-87b44d4f-b510-4dc7-9761-75dfe50c45b7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:56.615495 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-87b44d4f-b510-4dc7-9761-75dfe50c45b7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jul 14 20:26:56.615913 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:26:57.283382 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-d0d0e80b-8db4-4e24-bc58-c409e1492ca7 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:57.328788 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-d0d0e80b-8db4-4e24-bc58-c409e1492ca7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.701420 Jul 14 20:26:57.330329 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 14 20:26:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:26:59.918770 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-87b44d4f-b510-4dc7-9761-75dfe50c45b7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:26:59.920884 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-87b44d4f-b510-4dc7-9761-75dfe50c45b7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003055 Jul 14 20:26:59.921768 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:00.501278 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b48a5974-44ff-43cd-b005-82f82a452d9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:00.521508 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-b48a5974-44ff-43cd-b005-82f82a452d9e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.587668 Jul 14 20:27:00.522080 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:26:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:27:00.534302 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-16e794ca-3950-4f98-bca4-5763a5641021 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:00.558600 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-16e794ca-3950-4f98-bca4-5763a5641021 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028055 Jul 14 20:27:00.559233 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 14 20:27:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:27:03.144706 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b48a5974-44ff-43cd-b005-82f82a452d9e admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:03.145801 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-b48a5974-44ff-43cd-b005-82f82a452d9e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002323 Jul 14 20:27:03.146317 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:03.584811 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3ef9f6da-c77b-43a1-94d2-b7ce89da2932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "disk": 20, "vcpus": 1}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:03.605893 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3ef9f6da-c77b-43a1-94d2-b7ce89da2932 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452847 Jul 14 20:27:03.606658 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:27:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:27:03.621211 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-337b1c2a-dedb-4d8f-bc3d-c949c410d389 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:03.655980 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-337b1c2a-dedb-4d8f-bc3d-c949c410d389 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038983 Jul 14 20:27:03.662774 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 14 20:27:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:27:06.322053 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3ef9f6da-c77b-43a1-94d2-b7ce89da2932 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:06.324250 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3ef9f6da-c77b-43a1-94d2-b7ce89da2932 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002584 Jul 14 20:27:06.347479 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:07.056351 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ad5fe2a2-b4bc-4357-a9d2-a135dd5c86a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:07.076522 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ad5fe2a2-b4bc-4357-a9d2-a135dd5c86a7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.740211 Jul 14 20:27:07.077129 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:27:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:27:07.092457 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-0705166f-b2b5-4354-9367-bfe1014610e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:07.100277 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:27:07.123929 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-0705166f-b2b5-4354-9367-bfe1014610e3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037525 Jul 14 20:27:07.125227 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 14 20:27:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:27:09.715953 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ad5fe2a2-b4bc-4357-a9d2-a135dd5c86a7 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:09.717776 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ad5fe2a2-b4bc-4357-a9d2-a135dd5c86a7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002557 Jul 14 20:27:09.718527 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:27:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:27:10.319688 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9d2e97ea-d337-4b16-a017-bb9ac9f01727 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:10.346102 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9d2e97ea-d337-4b16-a017-bb9ac9f01727 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.620661 Jul 14 20:27:10.347170 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:27:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:27:10.362748 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-bb878ddb-9901-46f9-a586-e59eb2802231 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:10.366419 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:27:10.400510 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-bb878ddb-9901-46f9-a586-e59eb2802231 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041422 Jul 14 20:27:10.401216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 14 20:27:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:27:13.140032 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9d2e97ea-d337-4b16-a017-bb9ac9f01727 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:13.141503 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9d2e97ea-d337-4b16-a017-bb9ac9f01727 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jul 14 20:27:13.144267 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:13.861217 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-90cd8895-56f6-4c90-be2c-8e618e075639 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "id": "5"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:13.897372 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-90cd8895-56f6-4c90-be2c-8e618e075639 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.736495 Jul 14 20:27:13.897372 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 14 20:27:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:27:13.905698 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-cd93d9f3-eba8-4c46-833e-6174ae331ac5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:13.939469 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-cd93d9f3-eba8-4c46-833e-6174ae331ac5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037177 Jul 14 20:27:13.952648 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 14 20:27:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:27:32.667601 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-90cd8895-56f6-4c90-be2c-8e618e075639 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:32.668996 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-90cd8895-56f6-4c90-be2c-8e618e075639 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001897 Jul 14 20:27:32.669789 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:32.682004 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:27:33.132633 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c7431978-cf2c-4207-965e-4bd7c6c1be46 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:33.151796 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c7431978-cf2c-4207-965e-4bd7c6c1be46 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.474430 Jul 14 20:27:33.152384 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 14 20:27:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:27:34.404451 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-90cd8895-56f6-4c90-be2c-8e618e075639 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:34.405631 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-90cd8895-56f6-4c90-be2c-8e618e075639 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 14 20:27:34.406111 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:27:35.024133 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-03c85fec-a942-4531-8463-3a437d6cecd5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:35.031118 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-03c85fec-a942-4531-8463-3a437d6cecd5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-03c85fec-a942-4531-8463-3a437d6cecd5 admin admin] Request method failure captured: Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Accept: application/json Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Host: 10.222.0.52 Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABi0Hw2A_7-NxtrgNve6tdwTjiuhXS6jQaVbdh5f8KRFQ8tYAby2u2cAwtcZ2BjDeMOXc7O4KrKlfjQzEgn2mVSKXPl5cKwMqCUafmKbU27xQJzv10ooNTo5JQjkfEAGkxt9-aUpkJDEN-bTpiHsTDSWSV-q9lmQ6TYVYkxDXwj5YIYcZ0 Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jul 14 20:27:35.034632 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9054cd3a81847fdaa8f38a717dc0938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User: admin Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Id: 8b5c1280f1184855bd78412238939419 Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: method: > Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: exception: Flavor 42 could not be found. Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: action_args: {'id': '42'} Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:27:35.037950 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:35.039859 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.042199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-03c85fec-a942-4531-8463-3a437d6cecd5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:27:35.044595 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-03c85fec-a942-4531-8463-3a437d6cecd5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.486722 Jul 14 20:27:35.044595 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 14 20:27:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 488 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 20:27:35.047088 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-3c84ebff-bf3c-4667-a79b-df443c81762e admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:35.050194 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:27:35.071881 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-3c84ebff-bf3c-4667-a79b-df443c81762e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028833 Jul 14 20:27:35.072454 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 14 20:27:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:27:35.083456 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-fe55ae0f-0c21-4b29-aa17-a6330140738f admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:35.106264 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-fe55ae0f-0c21-4b29-aa17-a6330140738f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027090 Jul 14 20:27:35.106993 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 14 20:27:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:27:35.117546 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-04c1a273-19d9-476f-83f9-a66d65722848 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:35.126060 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-04c1a273-19d9-476f-83f9-a66d65722848 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-04c1a273-19d9-476f-83f9-a66d65722848 admin admin] Request method failure captured: Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Accept: application/json Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Host: 10.222.0.52 Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABi0Hw2A_7-NxtrgNve6tdwTjiuhXS6jQaVbdh5f8KRFQ8tYAby2u2cAwtcZ2BjDeMOXc7O4KrKlfjQzEgn2mVSKXPl5cKwMqCUafmKbU27xQJzv10ooNTo5JQjkfEAGkxt9-aUpkJDEN-bTpiHsTDSWSV-q9lmQ6TYVYkxDXwj5YIYcZ0 Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Role: reader,member,admin Jul 14 20:27:35.130852 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Roles: reader,member,admin Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9054cd3a81847fdaa8f38a717dc0938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User: admin Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Id: 8b5c1280f1184855bd78412238939419 Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: method: > Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: exception: Flavor 42 could not be found. Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: action_args: {'id': '42'} Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:27:35.133179 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:35.134645 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:35.136691 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-04c1a273-19d9-476f-83f9-a66d65722848 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:27:35.138885 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-04c1a273-19d9-476f-83f9-a66d65722848 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.019114 Jul 14 20:27:35.138885 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 14 20:27:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 20:27:36.237711 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-fe55ae0f-0c21-4b29-aa17-a6330140738f admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:36.239303 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-fe55ae0f-0c21-4b29-aa17-a6330140738f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002335 Jul 14 20:27:36.239899 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:36.994259 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e6a3dc9b-b624-4162-a9a9-d36cb6b4202c admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:37.004839 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-e6a3dc9b-b624-4162-a9a9-d36cb6b4202c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e6a3dc9b-b624-4162-a9a9-d36cb6b4202c admin admin] Request method failure captured: Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Accept: application/json Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Host: 10.222.0.52 Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABi0Hw4cBvyJEdgOctSJESCby9Jy8_-cYKB4mkyZqT5GeV8PueeBCtYwqwQy2w4TUa4rtkOvIYmvlgNqS3M7tk2nxvozEa8lmkl31rJztuM8arPujHFD4FbUf2HPl90szN3KnDeolw9THSLZD9Q3pHYO03Jfl-nUk1eELOFF-qQH6OWg8Y Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Role: reader,member,admin Jul 14 20:27:37.007792 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Roles: reader,member,admin Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9054cd3a81847fdaa8f38a717dc0938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User: admin Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Id: 8b5c1280f1184855bd78412238939419 Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: method: > Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: exception: Flavor 84 could not be found. Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: action_args: {'id': '84'} Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:27:37.009511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:37.010488 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.012511 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e6a3dc9b-b624-4162-a9a9-d36cb6b4202c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:27:37.015648 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-e6a3dc9b-b624-4162-a9a9-d36cb6b4202c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.613966 Jul 14 20:27:37.015648 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 14 20:27:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 616 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 20:27:37.028547 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ded1a129-aadc-4724-837a-7abec3c10ab1 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:37.046666 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ded1a129-aadc-4724-837a-7abec3c10ab1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024817 Jul 14 20:27:37.047291 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 14 20:27:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:27:37.058384 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-420018b0-e744-40b6-a4f0-8696559c087e admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:37.074061 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-420018b0-e744-40b6-a4f0-8696559c087e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019780 Jul 14 20:27:37.074814 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 14 20:27:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:27:37.085528 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d56847ff-ea9a-4d9b-bc25-3ae8f6bd5a13 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:37.091620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-d56847ff-ea9a-4d9b-bc25-3ae8f6bd5a13 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d56847ff-ea9a-4d9b-bc25-3ae8f6bd5a13 admin admin] Request method failure captured: Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Accept: application/json Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Host: 10.222.0.52 Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABi0Hw4cBvyJEdgOctSJESCby9Jy8_-cYKB4mkyZqT5GeV8PueeBCtYwqwQy2w4TUa4rtkOvIYmvlgNqS3M7tk2nxvozEa8lmkl31rJztuM8arPujHFD4FbUf2HPl90szN3KnDeolw9THSLZD9Q3pHYO03Jfl-nUk1eELOFF-qQH6OWg8Y Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jul 14 20:27:37.093420 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9054cd3a81847fdaa8f38a717dc0938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User: admin Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Id: 8b5c1280f1184855bd78412238939419 Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: method: > Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: exception: Flavor 84 could not be found. Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: action_args: {'id': '84'} Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:27:37.097938 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:37.099036 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:37.101707 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d56847ff-ea9a-4d9b-bc25-3ae8f6bd5a13 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:27:37.103599 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d56847ff-ea9a-4d9b-bc25-3ae8f6bd5a13 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013934 Jul 14 20:27:37.103599 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 14 20:27:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 20:27:38.162066 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-420018b0-e744-40b6-a4f0-8696559c087e admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:38.163132 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-420018b0-e744-40b6-a4f0-8696559c087e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 14 20:27:38.163552 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:38.779652 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-beea4cbf-eccf-4b6d-b5ed-1ed1df723376 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:38.786532 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-beea4cbf-eccf-4b6d-b5ed-1ed1df723376 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-beea4cbf-eccf-4b6d-b5ed-1ed1df723376 admin admin] Request method failure captured: Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Accept: application/json Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Host: 10.222.0.52 Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABi0Hw6Hm112WhAImPCE6o6ywVn1fpcvVVLGIcL31mFu9G3DyF4rygqr82WfMKO_bEsGovgkXWGA56UIAL8qJE9YMSV3ZZgz0r9ttUTxbCpyq69Rt5R8hVVihAYiopjhNZ9kQVIcT4HuYD10ZMLBfcGllWmsh28zOrGvOI38IMQhQaEuUc Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jul 14 20:27:38.788139 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9054cd3a81847fdaa8f38a717dc0938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User: admin Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Id: 8b5c1280f1184855bd78412238939419 Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: method: > Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: exception: Flavor 451 could not be found. Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: action_args: {'id': '451'} Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:27:38.790620 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:38.791531 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.793251 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-beea4cbf-eccf-4b6d-b5ed-1ed1df723376 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:27:38.795324 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-beea4cbf-eccf-4b6d-b5ed-1ed1df723376 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.484473 Jul 14 20:27:38.795324 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 14 20:27:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 486 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 20:27:38.803940 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-13e1e04f-9b69-41bd-a5ab-2e2d246ffaf1 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:38.818847 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-13e1e04f-9b69-41bd-a5ab-2e2d246ffaf1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019182 Jul 14 20:27:38.819506 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 14 20:27:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:27:38.830501 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:38.846130 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019561 Jul 14 20:27:38.847567 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 14 20:27:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:27:38.858376 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c17e733a-e9c4-4e1b-ba6c-755871fa0a10 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:38.865351 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-c17e733a-e9c4-4e1b-ba6c-755871fa0a10 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c17e733a-e9c4-4e1b-ba6c-755871fa0a10 admin admin] Request method failure captured: Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Accept: application/json Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Host: 10.222.0.52 Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABi0Hw6Hm112WhAImPCE6o6ywVn1fpcvVVLGIcL31mFu9G3DyF4rygqr82WfMKO_bEsGovgkXWGA56UIAL8qJE9YMSV3ZZgz0r9ttUTxbCpyq69Rt5R8hVVihAYiopjhNZ9kQVIcT4HuYD10ZMLBfcGllWmsh28zOrGvOI38IMQhQaEuUc Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Role: reader,member,admin Jul 14 20:27:38.866897 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Roles: reader,member,admin Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9054cd3a81847fdaa8f38a717dc0938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9054cd3a81847fdaa8f38a717dc0938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant-Id: a9054cd3a81847fdaa8f38a717dc0938 Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User: admin Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Id: 8b5c1280f1184855bd78412238939419 Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: method: > Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: exception: Flavor 451 could not be found. Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: action_args: {'id': '451'} Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:27:38.869252 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:38.871117 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jul 14 20:27:38.873216 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c17e733a-e9c4-4e1b-ba6c-755871fa0a10 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:27:38.875495 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c17e733a-e9c4-4e1b-ba6c-755871fa0a10 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014072 Jul 14 20:27:38.875495 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 14 20:27:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 20:27:40.488316 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:40.489347 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 14 20:27:40.489768 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:41.295065 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2c45ed2f-34e1-4a47-9412-90af9bd1e2b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:41.322750 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-2c45ed2f-34e1-4a47-9412-90af9bd1e2b3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.687575 Jul 14 20:27:41.323350 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 14 20:27:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:27:42.468220 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:42.469257 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 14 20:27:42.469682 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:43.133354 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2fad69c5-bdd8-4b29-bf2a-7562d67a2919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:43.152631 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-2fad69c5-bdd8-4b29-bf2a-7562d67a2919 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.536942 Jul 14 20:27:43.153184 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 14 20:27:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:27:44.316798 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:44.317807 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 14 20:27:44.318280 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:44.995644 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-af046da3-5d75-4e2e-a6d7-217cfc6a3e8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:45.017703 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-af046da3-5d75-4e2e-a6d7-217cfc6a3e8e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.554484 Jul 14 20:27:45.019306 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 14 20:27:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:27:46.119692 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:46.120855 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001785 Jul 14 20:27:46.121384 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:46.752406 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e095bb8c-37c0-42b9-ba80-6051103d5f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:27:46.780302 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-e095bb8c-37c0-42b9-ba80-6051103d5f76 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.515701 Jul 14 20:27:46.781370 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 14 20:27:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:27:47.962720 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:47.963792 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 14 20:27:47.964206 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:27:48.604115 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-17f1131b-6420-4e90-9349-0cf82ddc266b admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:27:48.624985 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-17f1131b-6420-4e90-9349-0cf82ddc266b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.513661 Jul 14 20:27:48.625577 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Thu Jul 14 20:27:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:28:43.399705 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:28:43.400928 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f77539e4-22a0-4245-8f01-6c02ea4028b5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 14 20:28:43.401349 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 14 20:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:28:43.413551 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:28:43.894007 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-12e806dd-e7e9-425c-b268-381d53fda1c0 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:28:43.914224 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-12e806dd-e7e9-425c-b268-381d53fda1c0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.505938 Jul 14 20:28:43.914785 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 14 20:28:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:28:43.936194 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=14 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:28:43.941454 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ca835547-ea90-42c5-8a06-b29cbb8e425f admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:28:43.949885 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ca835547-ea90-42c5-8a06-b29cbb8e425f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015006 Jul 14 20:28:43.950692 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Jul 14 20:28:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:28:43.964817 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-07d05542-1557-4b9b-8989-82640392616e admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:28:43.972791 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-07d05542-1557-4b9b-8989-82640392616e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013166 Jul 14 20:28:43.973364 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Jul 14 20:28:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:28:43.987593 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:28:44.001614 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018971 Jul 14 20:28:44.003041 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Jul 14 20:28:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:28:44.019271 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ce659cf3-a5fc-48d9-8a20-9ef1bf4c61f2 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:28:44.027443 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ce659cf3-a5fc-48d9-8a20-9ef1bf4c61f2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012410 Jul 14 20:28:44.027986 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Jul 14 20:28:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:32:32.322698 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:32.324199 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Jul 14 20:32:32.324676 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:32:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:32:32.466465 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=6 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:32:32.630575 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-443c4098-330b-4998-add8-02904c96d537 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:32.632210 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:32:32.632210 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jul 14 20:32:32.633443 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-443c4098-330b-4998-add8-02904c96d537 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:32.633883 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-443c4098-330b-4998-add8-02904c96d537 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:32.634671 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-443c4098-330b-4998-add8-02904c96d537 admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:32.635125 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-443c4098-330b-4998-add8-02904c96d537 admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:32.671991 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-443c4098-330b-4998-add8-02904c96d537 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.207060 Jul 14 20:32:32.672564 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 14 20:32:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:32:33.524688 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:33.525795 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Jul 14 20:32:33.526203 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:32:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:32:33.740827 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-81d9c2ed-fb0e-4c0e-a83b-e5939197bc12 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:33.742157 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:32:33.742157 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jul 14 20:32:33.745133 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-81d9c2ed-fb0e-4c0e-a83b-e5939197bc12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:33.745133 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-81d9c2ed-fb0e-4c0e-a83b-e5939197bc12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:33.745133 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-81d9c2ed-fb0e-4c0e-a83b-e5939197bc12 admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:33.745133 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-81d9c2ed-fb0e-4c0e-a83b-e5939197bc12 admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:33.765313 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-81d9c2ed-fb0e-4c0e-a83b-e5939197bc12 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.093817 Jul 14 20:32:33.765898 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 14 20:32:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:32:45.064723 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:45.065733 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 14 20:32:45.066639 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:32:45.219398 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=4 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:32:45.220099 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell1:SELECT=4 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:32:45.220768 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=8 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:32:45.271330 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-573a40bf-b414-4d42-8fdd-4794b702702d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:45.272798 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:32:45.272798 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jul 14 20:32:45.273920 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-573a40bf-b414-4d42-8fdd-4794b702702d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:45.274354 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-573a40bf-b414-4d42-8fdd-4794b702702d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:45.275153 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-573a40bf-b414-4d42-8fdd-4794b702702d admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:45.275574 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-573a40bf-b414-4d42-8fdd-4794b702702d admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:45.300290 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-573a40bf-b414-4d42-8fdd-4794b702702d admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085409 Jul 14 20:32:45.300880 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 14 20:32:45 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:32:46.146342 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:46.147682 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-05d2f5b6-a06a-4262-b508-4f48ad184695 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 Jul 14 20:32:46.148086 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 14 20:32:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:32:46.350426 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1bc99e26-5d1c-49d3-a907-fa5b8cb84b2c admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:32:46.351641 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 20:32:46.351641 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jul 14 20:32:46.352911 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1bc99e26-5d1c-49d3-a907-fa5b8cb84b2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:46.353305 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1bc99e26-5d1c-49d3-a907-fa5b8cb84b2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:46.354102 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1bc99e26-5d1c-49d3-a907-fa5b8cb84b2c admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:32:46.354526 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1bc99e26-5d1c-49d3-a907-fa5b8cb84b2c admin admin] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:32:46.376890 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1bc99e26-5d1c-49d3-a907-fa5b8cb84b2c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083690 Jul 14 20:32:46.377449 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 14 20:32:46 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:33:43.232495 dv-cinder-799871-32-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 20:33:43.233022 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: Thu Jul 14 20:33:43 2022 - graceful shutdown triggered... Jul 14 20:33:43.233461 dv-cinder-799871-32-iscsi devstack@n-api.service[103360]: Gracefully killing worker 1 (pid: 103360)... Jul 14 20:33:43.234520 dv-cinder-799871-32-iscsi devstack@n-api.service[103361]: Gracefully killing worker 2 (pid: 103361)... Jul 14 20:33:44.233976 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: worker 1 buried after 1 seconds Jul 14 20:33:44.234400 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: worker 2 buried after 1 seconds Jul 14 20:33:44.234400 dv-cinder-799871-32-iscsi devstack@n-api.service[103359]: goodbye to uWSGI. Jul 14 20:33:44.235607 dv-cinder-799871-32-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 20:33:44.236149 dv-cinder-799871-32-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 20:33:44.239056 dv-cinder-799871-32-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 20:33:44.249179 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 20:33:44.251771 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 20:33:44 2022] *** Jul 14 20:33:44.251926 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 20:33:44.252055 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 20:33:44.252180 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: nodename: dv-cinder-799871-32-iscsi Jul 14 20:33:44.252294 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: machine: x86_64 Jul 14 20:33:44.252409 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: clock source: unix Jul 14 20:33:44.252516 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: pcre jit disabled Jul 14 20:33:44.252623 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: detected number of CPU cores: 4 Jul 14 20:33:44.252729 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: current working directory: / Jul 14 20:33:44.252835 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: detected binary path: /usr/bin/uwsgi-core Jul 14 20:33:44.252947 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: your processes number limit is 47680 Jul 14 20:33:44.253068 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: your memory page size is 4096 bytes Jul 14 20:33:44.253200 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: detected max file descriptor number: 2048 Jul 14 20:33:44.253200 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: lock engine: pthread robust mutexes Jul 14 20:33:44.253386 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: thunder lock: enabled Jul 14 20:33:44.253551 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 20:33:44.253645 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 20:33:44.294088 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: Python main interpreter initialized at 0x55d309b6f9c0 Jul 14 20:33:44.294088 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: python threads support enabled Jul 14 20:33:44.294088 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: your server socket listen backlog is limited to 100 connections Jul 14 20:33:44.294088 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: your mercy for graceful operations on workers is 90 seconds Jul 14 20:33:44.294546 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 20:33:44.294546 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: *** Operational MODE: preforking *** Jul 14 20:33:44.294814 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: *** uWSGI is running in multiple interpreter mode *** Jul 14 20:33:44.294814 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: spawned uWSGI master process (pid: 124356) Jul 14 20:33:44.295041 dv-cinder-799871-32-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 20:33:44.297699 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: spawned uWSGI worker 1 (pid: 124370, cores: 1) Jul 14 20:33:44.297699 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: spawned uWSGI worker 2 (pid: 124371, cores: 1) Jul 14 20:33:44.297699 dv-cinder-799871-32-iscsi devstack@n-api.service[124356]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 20:33:44.964279 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 20:33:44.966104 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 20:33:46.143960 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:33:46.143960 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: from cryptography.utils import int_from_bytes Jul 14 20:33:46.144637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:33:46.144637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: from cryptography.utils import int_from_bytes Jul 14 20:33:46.153736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:33:46.153736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: from cryptography.utils import int_from_bytes Jul 14 20:33:46.154250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 20:33:46.154250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: from cryptography.utils import int_from_bytes Jul 14 20:33:48.470697 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 20:33:48.471365 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 20:33:48.471731 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 20:33:48.471938 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 20:33:48.472984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 20:33:48.473090 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 20:33:48.473090 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 20:33:48.473270 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 20:33:48.473367 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.473467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 20:33:48.473559 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.473650 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 20:33:48.473741 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.473952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.474550 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.474647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.474741 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.474869 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.475052 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.475226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.475568 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.475693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.475887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.476021 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.476212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.476379 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.476535 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.476641 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.476865 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.477038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.477165 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.477377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-32-iscsi {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.477508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.477703 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.477813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-32-iscsi {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.478013 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.478122 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.478324 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.478435 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.478646 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.478752 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.478972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.479071 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.479293 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.479397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.479599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.479705 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.479968 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.480103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.480475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.480589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.480793 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.480894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.481103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.481238 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.481417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.481543 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.481757 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.481849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.482068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.482173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.482382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.482482 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.482694 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.482792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.483042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.483196 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.483355 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.483493 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.483674 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.483778 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-32-iscsi {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.484060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.484158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-32-iscsi {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.484374 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.484471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.484691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.484788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.485009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.485127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.485407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.485522 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.485716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.485817 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.486030 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.486126 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.486358 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.486460 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.486665 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.486764 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.487018 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.487114 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.487343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.487463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.487666 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.487759 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.487990 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.488114 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.488296 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.488419 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.488607 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.488709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.488914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.489024 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.489230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.489350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.489562 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.489660 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.489869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.489973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.490124 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.490242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.490414 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.490503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.490730 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.490828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.491071 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.491222 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.491395 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.491499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.491647 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.491790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.491933 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.492031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.492202 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.492298 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.492524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.492689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.492829 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.492965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.493125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.493266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.493433 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.493533 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.493740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.493831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.494048 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.494139 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.494356 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.494455 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.494663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.494754 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.495022 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.495132 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.495305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.495419 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.495621 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.495730 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.495935 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.496033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.496241 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.496339 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.496562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.496665 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.496911 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.497012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.497200 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.497328 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.497499 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.497619 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.497840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.497986 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.498211 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.498330 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.498448 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.498567 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.498760 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.498905 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.499104 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.499231 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.499455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.499606 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.499726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.499848 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.500011 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.500151 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.500331 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.500454 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.500657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.500795 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.500962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.501079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.501199 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.501367 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.501496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.501607 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.501826 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.501952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.502112 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.502238 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.502418 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.502543 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.502728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.502853 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.503057 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.503183 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.503359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.503486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.503661 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.503786 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.503966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.504093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.504273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.504407 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.504621 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.504774 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.504915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.505055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.505228 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.505364 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.505502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.505595 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.505813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.505916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.506114 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.506207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.506420 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.506518 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.506743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.506846 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.507077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.507183 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.507387 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.507487 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.507696 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.507795 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.508002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.508093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.508313 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.508427 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.508620 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.508724 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.508923 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.509016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.509234 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.509335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.509599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.509748 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.509862 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.509973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.510149 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.510243 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.510456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.510562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.510764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.510865 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.511105 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.511200 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.511412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.511512 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.511720 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.511818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.512034 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.512152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.512346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.512472 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.512652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.512754 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.512959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.513058 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.513266 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.513359 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.513574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.513676 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.513881 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.513980 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.514183 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.514326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.514493 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.514582 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.514790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.514884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.515126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.515264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.515441 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.515567 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.515746 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.515868 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.516063 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.516158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.516357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.516447 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.516664 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.516766 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.516989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 20:33:48.517094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.517323 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.517416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.517657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.517756 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.517974 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.518063 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.518323 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.518460 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.518648 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.518741 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.518990 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.519086 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.519309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.519410 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.519626 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.519780 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.519948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.520037 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.520261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.520350 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.520580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.521327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.521434 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.521521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.521997 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.522161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.522319 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.522409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.522643 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.522743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.522982 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.523086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.523306 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.523398 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.523628 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.523729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.523945 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.524045 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.524265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.524357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.524592 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.524689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.524913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.525003 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.525295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.525431 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.525541 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.525649 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.525882 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.525977 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.526207 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.526299 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.526534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.526626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.526863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.527010 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.527219 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.527351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.527537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.527629 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.527853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.527958 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.528173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.528264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.528502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.528601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.528813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.528912 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.529136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.529228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.529451 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.529548 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.529765 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.529870 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.530079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.530171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.530389 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.530490 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.530702 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.530800 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.531043 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.531152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.531375 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.531472 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.531694 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.531788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.532008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.532099 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.532322 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.532412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.532639 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.532737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.532951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.533049 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.533265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.533394 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.533575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.533668 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.533884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.533981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.534190 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.534288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.534499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.534598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.534805 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.534902 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.535142 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.535248 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.535468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.535614 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.535773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.535873 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.536093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.536240 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.537194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.537324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.537454 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.537569 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.537857 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.538187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.538324 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.538437 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.538554 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.538731 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.538857 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.539086 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.539269 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.539394 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.539507 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.539713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.539842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.540087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.540224 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.540342 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.540451 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.541613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.541777 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.541876 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.541963 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542120 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542222 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542446 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542622 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.542890 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.543823 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.543994 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544119 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544231 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544351 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544459 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544547 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544630 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544773 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544867 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.544948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545042 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545219 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545302 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545393 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545477 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545630 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545630 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.545997 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.546138 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.546239 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.546444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.546543 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.546752 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.546851 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.547087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.547182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.547396 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.547499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.547702 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.547804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.548007 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.548100 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.548312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.548415 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.548617 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.548716 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.548941 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.549038 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.549249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.549339 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.549552 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.549652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.549857 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.549951 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.550167 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.550289 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.550497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.550622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.550801 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.550912 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.551134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.551259 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.551446 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.551613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.551758 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.551914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.552118 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.552264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.552412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.552574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.552763 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.552908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.553108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.553246 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.553436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.553588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.553750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.553889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.554067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.554217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.554388 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.554536 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.554729 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.554874 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.555072 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.555218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.555349 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.555441 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.555676 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.555805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.555990 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.556084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.556312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.556405 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.556619 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.556711 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.556936 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.557034 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.557269 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.557361 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.557587 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.557721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.557908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.558001 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.558217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.558309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.558530 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.558619 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.558847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.558967 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.559184 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.559284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.559496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.559595 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.559810 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.559915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.560124 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.560215 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.560448 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.560555 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.560759 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.560883 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.561074 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.561182 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.561493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.561656 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.561747 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.561916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.562012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.562103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.562312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.562449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.562625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.562751 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.563033 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.563164 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.563290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.563413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.563600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.563726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.563927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.564053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.564239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.564369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.564565 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.564901 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.565058 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.565377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.565694 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.566015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.566325 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.566637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.566969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.567303 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.567465 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.568295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.568412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.568625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.568726 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.568943 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.569054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.569261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.569361 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.569576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.569675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.569888 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.570012 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.570189 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.570293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.570500 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.570607 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.570828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.570975 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.571252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.571458 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.571629 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.571823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.571919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.572127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.572240 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.572445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.572546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.572759 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.572865 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.573111 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.573225 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.573414 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.573521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.573727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.573836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.574039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.574144 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.574350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.574455 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.574700 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.574807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.575040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.575140 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.575351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.575449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.575671 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.575781 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.576091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.576193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.576348 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.576470 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.576752 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.576877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.576956 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.577029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.577235 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.577341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.577558 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.577671 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.577901 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.577998 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.578218 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.578344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.578634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.578751 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.578910 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.579083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.579255 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.579357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.579703 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.579818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.579895 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.579975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.580171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.580276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.580487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.580654 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.580799 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.581100 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.581332 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.581502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.581660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.581806 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.582051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.582202 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.582202 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.582477 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.582637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.582790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.582976 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.583145 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.583927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.583927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.584230 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.584375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.584519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.584673 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.584819 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.584978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.585131 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.585285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.585439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.585602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.585747 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.585901 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.586053 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.586352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.586518 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.586666 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.586817 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587165 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587311 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587477 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587941 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.587941 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.588229 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.588426 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.588591 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.588892 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.589052 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.589198 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.589343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.589487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.589487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.589780 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.589939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.590084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.590228 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.590386 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.590539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.590692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.590848 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.591031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.591300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.591533 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.591683 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.591827 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.591996 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.592245 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.592396 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.592568 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.592836 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.593015 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.593179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.593379 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.593536 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.593688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.593848 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.594095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.594246 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.594446 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.594595 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.594739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.594890 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.595155 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.595306 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.595460 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.595605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.595756 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.595902 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.596056 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.596203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.596505 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.596668 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.596814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.596969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.597123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.597275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.597419 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.597571 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.597722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.597876 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.598021 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.598174 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.598326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.598492 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.598636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.599038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.599038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.599334 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.599480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.599630 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.599776 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.599930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.600083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.600285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.600436 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.600580 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.600746 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.600891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.601037 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.601187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.601444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.601677 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.601839 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.601992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.602146 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.602402 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.602555 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.602710 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.602952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.603118 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.603275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.603428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.603574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.603718 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.603878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.604035 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.604439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.604609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.604756 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.604915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.605068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.605231 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.605377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.605522 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.605674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.605827 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.605972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.606116 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.606261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.606606 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.606765 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.606925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.607118 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.607263 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.607419 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.607571 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.607726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.607885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.608039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.608183 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.608335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.608480 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.608639 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.608785 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.609095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.609257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.609412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.609576 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.609733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.609886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.610040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.610185 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.610329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.610482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.610642 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.610788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.610976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.611139 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.611285 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.611448 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.611729 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.611958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.612117 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.612270 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.612438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.612680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.612840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.612994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.613149 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.613293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.613438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.613596 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.613750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.613923 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.614079 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.614223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.615916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.616096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.616249 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.616395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.616541 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.616849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.617004 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.617179 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.617328 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.617531 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.617686 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.617830 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.617984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.618138 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.618283 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.618434 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.618579 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.618722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.618885 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.619072 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.619379 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.619534 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.619699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.619851 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.620007 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.620160 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.620314 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.620467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.620620 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.620771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.620926 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.621078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.621232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.621378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.621522 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.621925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.622163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.622325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.622472 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.622624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.622874 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.623101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.623250 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.623396 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.623539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.623690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.623842 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.623999 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.624157 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.624308 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.624471 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.624691 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.624840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.625006 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.625159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.625310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.625456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.625600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.625753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.625906 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.626071 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.639064 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.639886 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.640065 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.640222 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.640372 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.640528 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.640684 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.640840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.641260 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.641417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.641570 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.641718 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.641890 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.642037 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.642212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.642491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.642657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.642805 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.643024 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.643179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.643343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.643490 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.643643 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.643796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.643952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.644112 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.644258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.644423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.644569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.644714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.644866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.645025 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.645178 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.645323 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.645467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.645622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.646430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.646854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.647037 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.647194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.647347 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.647494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.647645 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.647823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.648129 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.648289 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.648434 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.648580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.648738 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.648904 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.649242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.649394 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.649540 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.649697 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.649931 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.650087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.650233 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.650377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.650528 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.650683 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.650842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.651103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.651497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.651673 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.651821 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.651966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.651966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.652266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.652422 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.652575 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.652575 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.652862 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.653008 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.653153 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.653297 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.653454 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.653600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.653755 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.653908 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.654055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.654199 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.654350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.654505 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.654665 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.654812 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.654977 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.655129 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.655292 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.656014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.656188 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.660769 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.661840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.662014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.662178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.662327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.662483 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.662638 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.662811 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.662989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.664408 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.664757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.664932 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.665112 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.665264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.665410 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.665556 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.665702 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.665858 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.666042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.666273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.667089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.667252 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.667419 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.667586 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.667744 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.667920 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.668070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.668947 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.669284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.669447 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.669595 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.669750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.669896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.670057 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.670204 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.670350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.670502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.670657 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.670803 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.670978 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.671143 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.671298 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.671462 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.671610 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.671773 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.671934 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.672088 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.672235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.672235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.672519 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.672680 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.672826 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.672971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.673131 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.673576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.673742 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.673899 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.674191 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.674464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.674626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.674782 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.674961 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.675133 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.675280 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.675425 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.675579 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.675726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.675880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.676046 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.676192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.676346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.676499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.676650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.676984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.677239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.677406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.677601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.677760 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.677914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.678080 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.678235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.678532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.678802 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.679014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.679176 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.679342 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.679513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.679674 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.679827 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.679980 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.680131 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.680293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.680445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.680609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.680762 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.680914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.681152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.681309 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.681461 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.681620 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.681780 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.681940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.682108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.682262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.682420 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.682572 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.682737 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.682889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.683088 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.683253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.683423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.684021 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.684198 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.684514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.684818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.684975 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.685136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.685291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.685464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.685632 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.685794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.685946 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.686112 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.686266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.686418 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.686578 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.686738 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.686897 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.687080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.687252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.687523 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.687706 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.687867 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.688020 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.688179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.688339 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.688518 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.688807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.689074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.689232 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.689385 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.689536 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.689704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.689857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.690029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.690180 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.690338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.690490 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.690656 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.690808 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.690997 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.691158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.691329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.691483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.691643 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.691801 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.691960 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.692129 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.692281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.692430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.693132 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.693422 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.693599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.693880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.694227 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.694396 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.694686 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.694993 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.695157 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.695309 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.695485 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.695647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.695809 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.695968 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.696120 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.696278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.696473 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.696653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.696807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.696958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.697117 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.697277 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.697440 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.697692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.697852 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.698015 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.698168 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.698326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.698487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.698639 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.698808 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.699085 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.699321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.699498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.699662 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.699832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.699985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.700135 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.700295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.700295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.700594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.700754 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.700915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.701069 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.701220 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.701385 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.701539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.701709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.701861 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.702014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.702165 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.702325 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.702489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.702649 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.702800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.702977 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.703138 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.703305 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.703468 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.703631 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.703789 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.704081 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.704394 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.704633 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.704914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.705252 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.705415 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.705576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.705738 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.705892 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.706044 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.706218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.706424 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.706593 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.706761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.706914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.707163 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.707319 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.707470 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.707634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.707815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.707967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.708127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.708851 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.709009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.709269 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.709536 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.709694 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.709846 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.709998 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.710158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.710322 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.710475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.710627 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.710787 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.710787 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.711140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.711302 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.711457 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.711608 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.711760 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.711918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.712081 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.712233 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.712384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.712544 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.712706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.712858 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.713030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.713191 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.713344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.713496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.713647 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.713812 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.713965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.714217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.714547 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.714547 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.714854 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.715253 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.715508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.715687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.715840 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.716043 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.716195 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.716368 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.716521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.716521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.716827 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.716979 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.717140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.717299 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.717459 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.717629 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.717783 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.717933 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.718406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.719855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.721034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.721034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.721034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.721534 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.721697 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.721878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.722040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.722192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.722352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.722503 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.722654 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.722860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.723039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.723039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.723343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.723343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.723661 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.723661 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.724010 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.724187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.724187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.724733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.724901 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.725066 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.725066 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.725494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.725494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.725900 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.726067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.726228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.726398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.726550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.726709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.726860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.727110 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.727269 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.727420 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.727579 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.727731 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.727882 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.728046 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.728207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.728359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.728565 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.728726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.728887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.729039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.729198 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.729359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.729605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.729849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.730017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.730171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.730322 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.730482 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.730634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.730796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.730976 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.731146 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.731306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.731467 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.731617 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.731769 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.731929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.732091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.732252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.732424 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.732585 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.732761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.739103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.739324 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.739535 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.739728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.739919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.740091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.740254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.740409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.740569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.740721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.740874 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.741042 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.741212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.741372 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.741372 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.741669 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.741822 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.741983 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.742144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.742304 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.742481 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.745539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.745743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.745908 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.746082 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.746295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.746466 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.750053 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.751202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.751382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.751506 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.751630 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.751745 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.751871 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.751994 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.752107 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.752226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.752341 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.752714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.752919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.753080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.753080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.753545 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.753545 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.753864 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.754019 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.754179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.754332 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.754484 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.754655 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.754818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.755556 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.756127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.756307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.756464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.756617 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.757222 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.757388 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.757544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.757718 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.757884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758217 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758373 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758495 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.758997 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.759125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.759247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.759360 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.759360 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.759833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.760141 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.760452 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.760622 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.761435 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.761607 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.761763 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.761924 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.762087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.762248 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.762411 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.762583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.762977 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.763180 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.763338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.763522 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.763678 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.763832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.763985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.764151 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.764315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.764501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.764501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.764501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.765016 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.765323 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.765484 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.765637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.765790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.766200 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.766481 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.766670 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.766827 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.767339 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.767525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.767680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.767847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.768019 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.768183 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.768337 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.768498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.768651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.768813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.768813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.769116 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.769270 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.769421 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.769574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.769735 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.769909 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.770070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.770233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.770392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.771322 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.771506 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.771913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.772771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.772948 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.773116 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.773286 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.773456 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.773612 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.773792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.773792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.774083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.774247 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.774404 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.774555 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.774707 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.774859 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.775064 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.775232 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.775395 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.775556 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.775726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.775878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.776041 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.776481 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.776800 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.776977 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.777504 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.777647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.777756 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.777919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.778073 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.778225 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.778225 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.778532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.778696 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.778835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.779071 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.779231 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.779384 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.779551 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.779706 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.779873 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.779989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780355 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780509 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780604 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780711 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.780979 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781188 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781286 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781479 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781575 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781678 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781765 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781851 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.781937 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782228 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782316 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782403 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782488 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782799 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.782900 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783185 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783283 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783371 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783553 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783638 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.783914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784000 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784178 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784473 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.784979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785076 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785348 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785680 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.785915 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786003 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786097 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786184 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786332 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.786494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.787732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.788368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.789062 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.789062 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 20:33:48.789062 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 20:33:48.905096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO dbcounter [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Registered counter for database nova_api Jul 14 20:33:48.912218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO dbcounter [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Registered counter for database nova_api Jul 14 20:33:48.925060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:48.932562 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_db.sqlalchemy.engines [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:48.932738 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writer thread running {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:48.939203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writer thread running {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:48.990468 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.context [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e48e7cb-a586-40dc-b694-2536a52d42ed(cell1) {{(pid=124370) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 20:33:48.994461 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:33:48.996105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:33:48.996330 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.context [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e48e7cb-a586-40dc-b694-2536a52d42ed(cell1) {{(pid=124371) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 20:33:48.996926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:33:48.998930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:33:49.000240 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:33:49.000947 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO dbcounter [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Registered counter for database nova_cell0 Jul 14 20:33:49.001828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:33:49.002645 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:33:49.004660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:33:49.005145 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO dbcounter [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Registered counter for database nova_cell1 Jul 14 20:33:49.007282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO dbcounter [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Registered counter for database nova_cell0 Jul 14 20:33:49.011375 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO dbcounter [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Registered counter for database nova_cell1 Jul 14 20:33:49.012960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:49.015860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:49.019142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_db.sqlalchemy.engines [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:49.020300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_db.sqlalchemy.engines [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:49.023050 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writer thread running {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:49.023398 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writer thread running {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:49.027297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writer thread running {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:49.028781 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writer thread running {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:49.169541 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO dbcounter [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Registered counter for database nova_cell0 Jul 14 20:33:49.174503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO dbcounter [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Registered counter for database nova_cell0 Jul 14 20:33:49.176531 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:49.183017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writer thread running {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:49.183447 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_db.sqlalchemy.engines [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 20:33:49.188419 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writer thread running {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 20:33:49.501965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: WARNING keystonemiddleware.auth_token [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:33:49.508233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: WARNING keystonemiddleware.auth_token [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:33:49.509925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: WARNING keystonemiddleware.auth_token [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:33:49.516334 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: WARNING keystonemiddleware.auth_token [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:33:49.854356 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: WARNING keystonemiddleware.auth_token [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:33:49.860391 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: WARNING keystonemiddleware.auth_token [None req-2fe102e7-bff3-49ee-87bf-2e4e8b305a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:33:49.863268 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: WARNING keystonemiddleware.auth_token [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 20:33:49.865718 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d309b6f9c0 pid: 124370 (default app) Jul 14 20:33:49.869229 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: WARNING keystonemiddleware.auth_token [None req-420dfe58-fdcd-49e4-a1be-96e1a97cffb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 20:33:49.874508 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d309b6f9c0 pid: 124371 (default app) Jul 14 20:34:36.318457 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:36.319684 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:36.320460 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:36.322716 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:36.579220 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2d7f7b4c-494c-4067-b068-5cb3c9e51cec tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb39ba3a0>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:37.131337 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2d7f7b4c-494c-4067-b068-5cb3c9e51cec tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ff7dac1f-4f8c-438e-a300-9dca083035b4" status: 200 len: 351 microversion: 2.1 time: 0.822334 Jul 14 20:34:37.132116 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 1/1] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:34:36 2022] GET /compute/v2.1/os-volumes/ff7dac1f-4f8c-438e-a300-9dca083035b4 => generated 351 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:34:38.862501 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:38.870060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:38.876193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:38.877050 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:34:39.488794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e138e51d-cc1f-47bc-9f2e-57ec900c8f27 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb39b5430>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:39.977944 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e138e51d-cc1f-47bc-9f2e-57ec900c8f27 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a1245d8e-6fc1-457c-93b0-6252653a55d2" status: 200 len: 351 microversion: 2.1 time: 1.122103 Jul 14 20:34:39.981315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:34:38 2022] GET /compute/v2.1/os-volumes/a1245d8e-6fc1-457c-93b0-6252653a55d2 => generated 351 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:34:41.493737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-53c5f55a-a49c-4320-97f1-06ba40c5de0e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'create', calling method: .version_select at 0x7fafb38845e0>, body: {"keypair": {"name": "tempest-keypair-1978963873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWSWhRntxVP08l90EegdBDGiH1NXsTYxVHcH3yaNXMzyCT1f8E4WnLHMPK3EmoCKRyhBriSZGaSmlCHG7bwG7uqE651jyfbSqXWXdK0JSUZ/zQp/d8jg5MbbrqK2uO4KQ=="}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:34:41.579488 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-53c5f55a-a49c-4320-97f1-06ba40c5de0e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:34:41.589798 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-53c5f55a-a49c-4320-97f1-06ba40c5de0e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for user 5cf43634335a428093ee30c2dd99187b and project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:34:41.666837 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-53c5f55a-a49c-4320-97f1-06ba40c5de0e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.276496 Jul 14 20:34:41.667555 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 2/3] 10.222.0.52 () {62 vars in 1199 bytes} [Thu Jul 14 20:34:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 278 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 20:34:43.122781 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-aa7ec3e9-ba45-4858-8e8c-6d119f3bab34 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb387e700>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:43.267921 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-aa7ec3e9-ba45-4858-8e8c-6d119f3bab34 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/15980675-103e-4f26-8b55-e14059c8a343" status: 200 len: 350 microversion: 2.1 time: 0.149221 Jul 14 20:34:43.276247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:34:43 2022] GET /compute/v2.1/os-volumes/15980675-103e-4f26-8b55-e14059c8a343 => generated 350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:34:43.283820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e979556e-2b6a-4ff8-b6b4-c20b7c769cf1 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb3818940>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:43.552928 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e979556e-2b6a-4ff8-b6b4-c20b7c769cf1 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.274004 Jul 14 20:34:43.553500 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Jul 14 20:34:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:43.567225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ac66be49-934f-463f-b219-0d614a8cfa5b tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb387edc0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:43.923965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ac66be49-934f-463f-b219-0d614a8cfa5b tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.361725 Jul 14 20:34:43.924509 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1148 bytes} [Thu Jul 14 20:34:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:34:43.937312 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a850948c-29bf-4d13-b615-5c9955578eb1 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb3818c10>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:44.096550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a850948c-29bf-4d13-b615-5c9955578eb1 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.163255 Jul 14 20:34:44.098171 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Jul 14 20:34:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:44.109254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-963808f9-5b6a-4660-83e9-f176f93da5a3 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb387ef70>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:44.243465 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-963808f9-5b6a-4660-83e9-f176f93da5a3 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.137940 Jul 14 20:34:44.244033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1166 bytes} [Thu Jul 14 20:34:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:34:44.262286 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e4705cf7-c6b5-4e33-837d-3fce896fd204 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb37ca940>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:44.511048 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e4705cf7-c6b5-4e33-837d-3fce896fd204 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.258368 Jul 14 20:34:44.512663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1169 bytes} [Thu Jul 14 20:34:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:34:44.525506 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ac01b826-70fe-4202-9634-e5d5179e2e16 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb383c310>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:44.748101 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ac01b826-70fe-4202-9634-e5d5179e2e16 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.226588 Jul 14 20:34:44.748787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Jul 14 20:34:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:44.761823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b8ebc5d5-3d16-4596-9ead-a7bcaacc0f09 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb383cf70>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:44.883640 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1307597333", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:34:44.998818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b8ebc5d5-3d16-4596-9ead-a7bcaacc0f09 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.240621 Jul 14 20:34:45.000680 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1187 bytes} [Thu Jul 14 20:34:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:34:45.011776 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6574bddc-4a18-46d7-8700-ab6151dcfd28 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] Calling method '.version_select at 0x7fafb383c940>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:45.076126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] validate_networks() for [('68cf6283-4fe3-4009-aca7-134fe5f10d19', None, None, None, None, None)] {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:34:45.204262 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6574bddc-4a18-46d7-8700-ab6151dcfd28 tempest-VolumesTestJSON-1861563685 tempest-VolumesTestJSON-1861563685-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.195422 Jul 14 20:34:45.219999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 7/12] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Jul 14 20:34:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:34:45.241003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1298683669", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc4df55f-56f1-4441-a13c-56b6d6bdcde5"}], "security_groups": [{"name": "tempest-securitygroup--2117579732"}], "key_name": "tempest-keypair-1978963873", "user_data": "}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:34:45.865259 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] validate_networks() for [('fc4df55f-56f1-4441-a13c-56b6d6bdcde5', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:34:47.690703 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:34:47.691823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:34:47.692202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:34:47.695184 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:34:47.695674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:34:47.752569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:34:47.755937 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:34:47.760007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:34:47.761059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:34:47.761822 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:34:47.782164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:47.782635 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:47.786925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:47.786925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:47.793932 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:47.794444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:47.799234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:47.799877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:47.870779 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for project cceb4db55bba4bd099104acdcb6d2762. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:34:47.884147 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for user 765c911957bd4ca68dd520fc4fbba1c9 and project cceb4db55bba4bd099104acdcb6d2762. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:34:47.919855 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:34:47.930553 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:34:47.953314 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:34:47.988548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for user 5cf43634335a428093ee30c2dd99187b and project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:34:48.044429 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:34:48.060773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:34:48.165546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-495df139-e066-41c7-ba37-99d8b44f617d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.617712 Jul 14 20:34:48.166195 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 6/13] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:34:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 3619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:34:48.177440 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ea8e178f-6d81-43ff-bea4-f9a180d9e5b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:48.178084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ea8e178f-6d81-43ff-bea4-f9a180d9e5b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:48.328534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-78431e93-4b00-4d24-b54c-75d580f4cb77 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.107151 Jul 14 20:34:48.332957 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 8/14] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Jul 14 20:34:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 20:34:48.348499 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f2f489df-4548-41ac-84a4-4adeef7a708e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:48.350184 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f2f489df-4548-41ac-84a4-4adeef7a708e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:48.506675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ea8e178f-6d81-43ff-bea4-f9a180d9e5b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:48.542185 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ea8e178f-6d81-43ff-bea4-f9a180d9e5b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1222 microversion: 2.1 time: 0.369190 Jul 14 20:34:48.545559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 7/15] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:48 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1222 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:34:48.615764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f2f489df-4548-41ac-84a4-4adeef7a708e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:48.664809 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f2f489df-4548-41ac-84a4-4adeef7a708e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:48.666576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f2f489df-4548-41ac-84a4-4adeef7a708e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:48.667764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f2f489df-4548-41ac-84a4-4adeef7a708e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1282 microversion: 2.20 time: 0.328260 Jul 14 20:34:48.688837 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 9/16] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:34:48 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1282 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:34:49.244636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1207335071", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:34:49.377385 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] validate_networks() for [('68cf6283-4fe3-4009-aca7-134fe5f10d19', None, None, None, None, None)] {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:34:49.942197 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-147438409", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "networks": [{"uuid": "523205c6-ae77-41d6-92fb-64291a948538"}]}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:34:50.098203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] validate_networks() for [('523205c6-ae77-41d6-92fb-64291a948538', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:34:52.078569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:34:52.079151 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:34:52.080342 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:34:52.081096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:34:52.081567 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:34:52.094999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:34:52.096024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:34:52.096704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:34:52.097365 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:34:52.097986 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:34:52.107545 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:52.115914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:52.116583 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:52.117700 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:52.118360 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:52.123070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:52.124397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:52.126400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:52.157719 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Getting quotas for project 7ccdb0dd0a034f008329f489ed3f7d4d. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:34:52.166903 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Getting quotas for user 2fdc04cfa44f4a21a1ce9854fd43c068 and project 7ccdb0dd0a034f008329f489ed3f7d4d. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:34:52.173396 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for project cceb4db55bba4bd099104acdcb6d2762. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:34:52.180614 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for user 765c911957bd4ca68dd520fc4fbba1c9 and project cceb4db55bba4bd099104acdcb6d2762. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:34:52.197591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:34:52.206074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:34:52.209365 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:34:52.216060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:34:52.319173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8e39a1db-d8eb-4cb8-926d-f78e3a60daa7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.083152 Jul 14 20:34:52.320167 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 8/17] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:34:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:34:52.329965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:52.333101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:52.342859 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-47e2ddfc-aeb0-4e8a-855c-31cb279dad5c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.732977 Jul 14 20:34:52.356096 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 10/18] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 20:34:52.410204 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:52.410855 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:52.412277 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:52.412865 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:52.904442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:52.942347 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:52.948638 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:52.955902 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0f79846d-d31b-48d7-b688-0f103f77ea0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1286 microversion: 2.20 time: 0.633023 Jul 14 20:34:52.957064 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 9/19] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:34:52 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1286 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:34:52.974019 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-40e2ef3f-e23a-46fd-a676-c89dc5db30cd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: .version_select at 0x7fafb2712940>, body: {"keypair": {"name": "tempest-keypair-1714595242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2Hhf7TEIyTkp5qd040/rd+Q4hpxMWKMUQ9jUgtgmvbd5v6sjj/iuhJXFDh+o1cMzcxVM8x2SavGUxQAQbog67cL9j3oec7T5JguI2B7AV7Q73gPAxWsrGjwiOAVjgpXg=="}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:34:52.976119 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-005f069e-aee3-4619-bd11-77f4682a65c2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:52.978297 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-005f069e-aee3-4619-bd11-77f4682a65c2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:53.064432 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-40e2ef3f-e23a-46fd-a676-c89dc5db30cd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:34:53.085346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-40e2ef3f-e23a-46fd-a676-c89dc5db30cd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:34:53.138005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-005f069e-aee3-4619-bd11-77f4682a65c2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:53.175284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-005f069e-aee3-4619-bd11-77f4682a65c2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1222 microversion: 2.1 time: 0.209284 Jul 14 20:34:53.176306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 10/20] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:52 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1222 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:53.197784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c2df0e04-079b-4277-813e-1f7f447aca0b tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:53.199891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c2df0e04-079b-4277-813e-1f7f447aca0b tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:53.227491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-40e2ef3f-e23a-46fd-a676-c89dc5db30cd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.869276 Jul 14 20:34:53.235062 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 11/21] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:34:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:34:53.500528 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c2df0e04-079b-4277-813e-1f7f447aca0b tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:53.509003 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c2df0e04-079b-4277-813e-1f7f447aca0b tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1214 microversion: 2.1 time: 0.328793 Jul 14 20:34:53.509591 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 11/22] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:53 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:53.975681 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:53.976834 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:53.986354 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:53.986808 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:53.990978 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:53.993474 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:54.194654 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:54.195409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:54.213713 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:54.214166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:54.219555 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:54.223899 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:54.796554 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:54.817774 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:54.819877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:54.821265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cc22f815-b279-443a-b204-752265d52617 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1286 microversion: 2.20 time: 0.850730 Jul 14 20:34:54.822181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 12/23] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:34:53 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1286 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:34:54.827397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:54.828310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:54.837252 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:54.837876 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:54.839026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:54.839622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:54.839796 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:54.847642 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b629aba3-10cc-4ce6-97d8-1a37bd36909c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1226 microversion: 2.1 time: 0.658359 Jul 14 20:34:54.848226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 12/24] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:54 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1226 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:54.966474 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:54.978576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7b167bd4-e928-42d9-82fa-f0dd3c8e5fd8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1210 microversion: 2.1 time: 0.155002 Jul 14 20:34:54.979375 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 13/25] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:54 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:55.848641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:55.850318 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:55.874262 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:55.875203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:55.876673 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:55.878396 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:55.889810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:55.889810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:55.899409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:55.899882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:55.906597 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:55.907178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:56.518094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:56.529882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f1b62483-012c-4bb4-9153-a6c14159c793 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1274 microversion: 2.1 time: 0.667554 Jul 14 20:34:56.531769 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 14/26] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:55 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1274 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:56.542571 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:56.546693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:56.601314 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:56.601518 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:56.601844 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:56.602868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:56.611095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:56.631989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:56.634651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:56.664722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6de081e4-d907-4989-a31f-ab904ee81ea7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1342 microversion: 2.20 time: 0.828634 Jul 14 20:34:56.669451 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 13/27] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:34:55 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1342 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:34:57.176328 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:57.189953 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-280aa71f-3649-4abf-b844-18734882629f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1274 microversion: 2.1 time: 0.656613 Jul 14 20:34:57.190604 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 15/28] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:56 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1274 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:57.555509 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:57.556095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:57.587442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:57.588015 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:57.597705 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:57.603930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:57.686317 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:57.687202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:57.720617 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:57.722301 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:57.727196 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:57.732829 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:58.245749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:58.258569 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:58.259128 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f2bfdd08-5000-4e6f-aece-83ce6bc60d87 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1280 microversion: 2.1 time: 0.705417 Jul 14 20:34:58.261331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 14/29] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:57 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1280 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:58.268251 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:58.273456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:58.276961 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9168724c-990f-4ccc-a135-ea0c92b481f1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1340 microversion: 2.20 time: 0.595047 Jul 14 20:34:58.279139 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 16/30] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:34:57 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1340 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:34:58.293476 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-907596275", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "946dd351-5829-4dff-b5e5-6e232f299044"}], "security_groups": [{"name": "tempest-securitygroup--819476431"}], "key_name": "tempest-keypair-1714595242", "user_data": "}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:34:58.301788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:58.302466 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:58.323555 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:58.327804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:58.330297 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:58.331758 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:58.563279 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] validate_networks() for [('946dd351-5829-4dff-b5e5-6e232f299044', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:34:58.751290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:58.772032 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-86ab5373-6a38-4b6e-b42c-d55452fcbde3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1272 microversion: 2.1 time: 0.509067 Jul 14 20:34:58.778828 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 15/31] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:58 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1272 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:59.278260 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:59.278885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:59.289239 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:59.289741 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:59.290556 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:59.292844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:59.435842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:59.453180 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6a3c137b-4393-4437-a1c8-b115fac4c373 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1280 microversion: 2.1 time: 0.172959 Jul 14 20:34:59.462709 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 16/32] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:59 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:34:59.467610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:59.468235 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:59.499791 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:59.500253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:59.501038 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:59.501484 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:59.664177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:59.677573 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:59.691113 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:34:59.692411 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2b7f4888-c892-4e69-9ac4-4bef1c8647d8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1340 microversion: 2.20 time: 0.236996 Jul 14 20:34:59.693173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 17/33] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:34:59 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1340 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:34:59.799179 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:34:59.801083 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:34:59.822546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:59.823038 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:34:59.832636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:34:59.839143 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:00.011586 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:35:00.012624 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:35:00.013469 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:35:00.014080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:35:00.014701 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:35:00.042018 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:00.048770 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:00.050642 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:00.051327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:00.094608 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:00.096259 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:35:00.108283 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:35:00.110618 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-63e88cd5-d77e-44ed-b2ee-95bb4d12073f tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1272 microversion: 2.1 time: 0.316466 Jul 14 20:35:00.123521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 18/34] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:34:59 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:00.148140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:35:00.155203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:35:00.264184 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a85c92f5-241c-4342-a76f-a23dba116c02 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.980730 Jul 14 20:35:00.264839 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 17/35] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:34:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:35:00.277152 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ba17992e-26b4-4989-894e-7b2cdeef3b24 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:00.277803 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ba17992e-26b4-4989-894e-7b2cdeef3b24 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:00.409970 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ba17992e-26b4-4989-894e-7b2cdeef3b24 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:00.417584 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ba17992e-26b4-4989-894e-7b2cdeef3b24 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1241 microversion: 2.1 time: 0.145165 Jul 14 20:35:00.422866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 19/36] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:00 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:00.470564 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:00.471400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:00.483866 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:00.484965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:00.485910 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:00.486664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:00.724879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:00.725589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:00.757972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:00.759703 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:00.765843 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:00.767226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:01.022194 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:01.030895 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:01.032472 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:01.033609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ed73a6e6-2d20-4fee-8d21-0dfccc30b333 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1340 microversion: 2.20 time: 0.324953 Jul 14 20:35:01.060075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 20/37] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:00 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1340 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:35:01.130509 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:01.132642 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:01.164271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:01.167851 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:01.168805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:01.169269 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:01.392283 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:01.404873 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-410fa370-5c55-499b-afbf-2da7a864b28b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.938764 Jul 14 20:35:01.410739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 18/38] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:00 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:01.439966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:01.441284 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:01.444397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:01.458309 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dcd0ab60-961f-47c9-9f43-553867a1ec44 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1272 microversion: 2.1 time: 0.331398 Jul 14 20:35:01.460961 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 21/39] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:01 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:01.462526 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:01.463463 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:01.467328 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:01.468003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:02.078284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:02.079429 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:02.093657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:02.094326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:02.095350 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:02.102864 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:02.153938 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=4 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:02.379544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:02.407519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b3ea7fa0-74c4-473d-9294-ceeba6f2aa55 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1245 microversion: 2.1 time: 0.968282 Jul 14 20:35:02.408369 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 19/40] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:01 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1245 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:02.426570 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:02.435086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:02.472931 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:02.473480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:02.474341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:02.474794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:02.668434 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:02.696514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:02.702606 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:02.705899 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a313679d-cf26-4dbc-b71b-cb293ddf2395 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1340 microversion: 2.20 time: 0.629805 Jul 14 20:35:02.710486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 22/41] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:02 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1340 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:35:02.723304 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:02.726474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:02.790201 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:02.794244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:02.795599 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:02.799663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:03.728663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:03.753522 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2d69ac26-91d7-4c7f-9ccf-6d3eccdfac94 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1272 microversion: 2.1 time: 1.040854 Jul 14 20:35:03.759175 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 23/42] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:02 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1272 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:03.779926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:03.781066 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:03.794343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:03.796399 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:03.798689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:03.801539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:04.384085 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:04.398319 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7553cab3-5723-4181-b51f-c65531f594bf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1299 microversion: 2.1 time: 0.636966 Jul 14 20:35:04.398914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 24/43] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:03 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1299 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:04.417879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:04.423436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:04.463158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:04.464064 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:04.465767 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:04.467659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:05.380418 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:05.402973 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e0b3d684-9f12-456a-a513-ff02f800d906 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 2.975581 Jul 14 20:35:05.417952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 20/44] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:02 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:05.437092 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:05.439406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:05.463501 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:05.465629 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:05.469039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:05.469532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:05.977484 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:05.986316 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:05.988796 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:05.989964 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c8465d03-8c1b-42c6-b208-fcf200038f22 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 1.583974 Jul 14 20:35:05.990502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 25/45] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:04 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:06.000566 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:06.001947 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:06.008818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.009626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.010811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.011513 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.117963 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:06.125813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d2757ffc-9235-4d70-8ff3-4e26e3c47476 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1299 microversion: 2.1 time: 0.134086 Jul 14 20:35:06.127069 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 26/46] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:05 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:06.151338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:06.176394 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5ff84a81-85ce-4847-a579-fe9828718245 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.753743 Jul 14 20:35:06.178537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 21/47] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:05 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:06.385408 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-a00a387b-43df-41f5-97ac-4c275260d578 req-cd5bf125-a23f-423b-ab10-98371a8da95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e709bc-663e-4241-bdc4-350e7c4d6ce4", "tag": "33ce41a8-cfae-480a-8e36-a527518059f8"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:06.402586 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a00a387b-43df-41f5-97ac-4c275260d578 req-cd5bf125-a23f-423b-ab10-98371a8da95f service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.403773 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a00a387b-43df-41f5-97ac-4c275260d578 req-cd5bf125-a23f-423b-ab10-98371a8da95f service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.426894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:06.428193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:06.435597 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-a00a387b-43df-41f5-97ac-4c275260d578 req-cd5bf125-a23f-423b-ab10-98371a8da95f service nova] Creating event network-changed:33ce41a8-cfae-480a-8e36-a527518059f8 for instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 on hv-cinder-79987 Jul 14 20:35:06.436469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a00a387b-43df-41f5-97ac-4c275260d578 req-cd5bf125-a23f-423b-ab10-98371a8da95f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124370) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 20:35:06.437965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-564bd6c5-246c-4163-9b14-2eda2f907b4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.438591 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-564bd6c5-246c-4163-9b14-2eda2f907b4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.439763 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-564bd6c5-246c-4163-9b14-2eda2f907b4b None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.440259 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.440474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-564bd6c5-246c-4163-9b14-2eda2f907b4b None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.441357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.443842 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.444340 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.454315 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.compute.rpcapi [None req-564bd6c5-246c-4163-9b14-2eda2f907b4b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 20:35:06.456584 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-564bd6c5-246c-4163-9b14-2eda2f907b4b None None] Releasing lock "compute-rpcapi-router" {{(pid=124370) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 20:35:06.508143 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-564bd6c5-246c-4163-9b14-2eda2f907b4b None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379572 Jul 14 20:35:06.508990 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 27/48] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:06.825462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:06.836300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-bdec32bc-3594-421d-906f-1068871d4260 req-ae33c747-8ec2-4653-81f0-51c62f878f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476db6db-4757-4a95-a7b8-7fab0e3f6a68", "tag": "1f90d544-e4b7-4775-8f93-61ce62d596b4"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:06.840061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:06.845514 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9a235d76-6d78-4e34-91c8-b3d5d77ec4e6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.419917 Jul 14 20:35:06.849320 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-bdec32bc-3594-421d-906f-1068871d4260 req-ae33c747-8ec2-4653-81f0-51c62f878f7b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:06.849796 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-bdec32bc-3594-421d-906f-1068871d4260 req-ae33c747-8ec2-4653-81f0-51c62f878f7b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:06.854587 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:06.867125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 22/49] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:06 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:06.873411 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-bdec32bc-3594-421d-906f-1068871d4260 req-ae33c747-8ec2-4653-81f0-51c62f878f7b service nova] Creating event network-changed:1f90d544-e4b7-4775-8f93-61ce62d596b4 for instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 on hv-cinder-79987 Jul 14 20:35:06.880995 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-bdec32bc-3594-421d-906f-1068871d4260 req-ae33c747-8ec2-4653-81f0-51c62f878f7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139820 Jul 14 20:35:06.882147 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 28/50] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:35:07.008129 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:07.008742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:07.014867 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.015350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:07.016118 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.016552 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:07.144645 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:07.149958 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:07.153470 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:07.158272 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:07.160365 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.160519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:07.160831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:07.161547 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-36734ad8-69b6-4f0e-a173-302cb704a76d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.157363 Jul 14 20:35:07.161651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.162113 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:07.162569 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 23/51] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:07 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:07.193982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:07.194826 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:07.202089 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.203246 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:07.209059 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.209808 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:07.351356 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:07.359841 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7b3e9c81-fa95-4368-8036-ac92e64c19aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.220218 Jul 14 20:35:07.369617 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 29/52] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:07 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:07.380221 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:07.388553 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-db32434a-25cf-48de-bef6-bdaf46376d17 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.198461 Jul 14 20:35:07.389128 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 24/53] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:07 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:07.883315 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:07.883315 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:07.933085 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.934624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:07.936783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:07.938113 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:08.140108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:08.151317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6ecd0a90-964a-4641-97ac-661bd9cee5bb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.276424 Jul 14 20:35:08.166294 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 30/54] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:07 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:08.180321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:08.181055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:08.187555 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:08.188070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:08.188978 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:08.189320 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:08.377735 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:08.378436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:08.386358 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:08.387103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:08.388126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:08.388860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:08.395443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:08.412775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:08.414216 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:08.421773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5e11c986-55d5-4d70-adbe-0df73f78415e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.244262 Jul 14 20:35:08.423352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 25/55] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:08 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:08.428445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:08.429064 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:08.448191 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:08.448940 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:08.450111 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:08.450872 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:08.633913 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:08.642598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a6ef3da0-7fae-4036-a759-d9c3167acb49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.269702 Jul 14 20:35:08.645780 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 31/56] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:08 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:08.687755 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:08.695090 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-85b2f529-bc33-4597-8528-502fba310339 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.270638 Jul 14 20:35:08.704883 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 26/57] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:08 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:09.173373 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:09.175577 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:09.182551 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.183055 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.183996 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.184597 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.375898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:09.385502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a8ef11bf-b809-47d9-b0af-435cd0237d0f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.214880 Jul 14 20:35:09.388373 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 32/58] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:09 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:09.440892 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:09.442317 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:09.449437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.449872 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.450497 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.450983 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.644827 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:09.647655 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=95 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:09.654620 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:09.656668 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:09.658360 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-21d2c759-46a4-4360-ad35-6bb4ec31fa6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.222112 Jul 14 20:35:09.660045 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 27/59] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:09 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:09.665253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:09.665990 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:09.673562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.674298 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.676460 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.677062 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.712200 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:09.712884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:09.715160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:09.723594 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.724403 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.725410 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:09.726055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:09.904942 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:09.919345 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e8fa78f3-9888-40ac-9adc-676ef05e0881 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.260068 Jul 14 20:35:09.927257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 33/60] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:09 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:09.946438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:09.955377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1358d197-ffbe-4edc-9210-841bf4c8c4f7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.247449 Jul 14 20:35:09.957051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 28/61] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:09 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:10.407067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:10.407692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:10.413691 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.414276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:10.415095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.415542 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:10.416083 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=24 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:10.562070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:10.571214 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b27e90ef-d177-4633-9ad9-da38f7f31661 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.167975 Jul 14 20:35:10.571794 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 34/62] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:10 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:10.684927 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:10.685541 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:10.688034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=6 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:10.688889 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=24 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:10.696572 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.697393 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:10.698349 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.698961 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:10.913852 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:10.923430 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:10.928690 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:10.930206 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c789f0a2-7060-4842-b144-8f789169d1e4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.249680 Jul 14 20:35:10.938126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:10.938984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:10.944421 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 29/63] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:10 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:10.948264 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.948886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:10.949807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.950389 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:10.972954 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:10.973569 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:10.979711 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.980158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:10.980922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:10.981360 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:11.199387 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:11.218103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2900c0f6-6932-4140-b165-22bae8e24889 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.279364 Jul 14 20:35:11.219446 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 35/64] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:10 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:11.239622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:11.248674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9e69d70b-93f9-442b-9984-fa35a790a2d1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.279449 Jul 14 20:35:11.249588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 30/65] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:10 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:11.587650 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:11.588262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:11.594305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:11.594766 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:11.595569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:11.596012 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:11.794258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:11.802844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-02c4a392-8448-422f-84f4-d0f2ff523aa5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.218946 Jul 14 20:35:11.813337 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 36/66] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:11 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:11.953903 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:11.955399 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:11.966345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:11.967080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:11.968060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:11.968507 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:12.128609 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:12.138291 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:12.139961 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:12.141150 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f9e859e2-c030-49ab-afba-bb902ddaf370 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.191391 Jul 14 20:35:12.142095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 31/67] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:11 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:12.236511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:12.237678 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:12.244104 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:12.244558 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:12.245335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:12.245776 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:12.267499 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:12.268494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:12.287376 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:12.288236 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:12.290822 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:12.292134 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:12.457938 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:12.466648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-07364a8f-fd34-432b-b22f-05f917d0c511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.233979 Jul 14 20:35:12.467456 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 37/68] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:12 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:12.557850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:12.568713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-34d6a282-fdd3-4977-9c96-4b72cd8ed06e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.306575 Jul 14 20:35:12.569301 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 32/69] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:12 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:12.821663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:12.822483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:12.832130 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:12.833539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:12.834354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:12.834804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:13.069282 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:13.098712 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a80339dc-ece3-47dc-b93d-8a5c66e5ab2d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.281103 Jul 14 20:35:13.115055 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 38/70] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:12 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:13.161599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:13.162194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:13.187885 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:13.188364 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:13.189116 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:13.189547 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:13.408212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:13.422357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:13.425599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:13.427132 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-09a36c08-a62c-4a0b-beea-4ba106c8b13c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.270220 Jul 14 20:35:13.428807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 33/71] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:13 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:13.489168 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:13.490857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:13.498861 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:13.499442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:13.500344 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:13.501035 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:13.588156 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:13.589539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:13.598848 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:13.599986 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:13.601048 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:13.601714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:13.716381 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:13.732537 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7a924472-e999-48fa-8c7b-8378cf5d49df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.252140 Jul 14 20:35:13.733349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 39/72] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:13 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:13.791311 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:13.799949 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4d3e751e-c70b-4b97-818f-70d023ace6d7 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.216192 Jul 14 20:35:13.800661 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 34/73] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:13 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:14.121582 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:14.122193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:14.128844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.129298 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:14.130121 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.130560 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:14.286807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:14.294775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dc9ca9b6-1572-4d5e-8618-5b8a31fb8227 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.177178 Jul 14 20:35:14.295717 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 40/74] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:14 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:14.447185 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:14.447841 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:14.454179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.454674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:14.455411 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.456104 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:14.626993 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:14.636180 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:14.637707 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:14.638866 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-234976d6-6f94-4d2e-aad3-4d2f56a81df2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.196324 Jul 14 20:35:14.639679 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 35/75] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:14 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:14.766722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:14.767953 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:14.776482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.778728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:14.780383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.781353 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:14.817589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:14.818461 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:14.825367 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.826315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:14.827205 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:14.828193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:15.614760 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:15.636248 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-254a338e-7b3e-4155-83d9-60c0b765435d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.879625 Jul 14 20:35:15.637882 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 41/76] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:14 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:15.658446 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:15.661126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:15.671761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:15.676431 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:15.676985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:15.677919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:15.678392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:15.700343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-28c17b13-0ef0-41cb-b80b-c12966d28f50 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.887175 Jul 14 20:35:15.701356 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 36/77] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:14 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:15.736398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:15.737599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:15.749200 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:15.749969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:15.753223 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:15.756412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:16.243527 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:16.252675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-207b0c69-cde6-4063-bf62-834603b47c49 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.612008 Jul 14 20:35:16.253280 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 42/78] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:15 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:16.266979 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-2dfbee5e-38fd-4099-9ff5-197983698b49 req-80e8ab72-149a-4e35-95ef-4ab107ddf273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad8c60a-cc83-4ab7-beab-7c1a2b31c830", "tag": "59599dd6-29f1-4ecf-91d4-36c5c1372812"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:16.277577 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-2dfbee5e-38fd-4099-9ff5-197983698b49 req-80e8ab72-149a-4e35-95ef-4ab107ddf273 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:16.278219 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-2dfbee5e-38fd-4099-9ff5-197983698b49 req-80e8ab72-149a-4e35-95ef-4ab107ddf273 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:16.296029 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-2dfbee5e-38fd-4099-9ff5-197983698b49 req-80e8ab72-149a-4e35-95ef-4ab107ddf273 service nova] Creating event network-changed:59599dd6-29f1-4ecf-91d4-36c5c1372812 for instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 on hv-cinder-79987 Jul 14 20:35:16.301745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-2dfbee5e-38fd-4099-9ff5-197983698b49 req-80e8ab72-149a-4e35-95ef-4ab107ddf273 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039476 Jul 14 20:35:16.302919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 43/79] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:16.428551 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:16.442521 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:16.444405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:16.446072 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ba9a5c13-dcda-46e3-9bae-7ae17e4a281e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.722244 Jul 14 20:35:16.446781 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 37/80] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:15 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:16.655637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:16.656355 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:16.672120 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:16.676257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:16.676257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:16.676732 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:16.677476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:16.730407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:16.731740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:16.739306 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:16.739807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:16.740581 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:16.741012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:17.443095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:17.458021 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:17.460109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-36db6320-d4c0-4a23-9061-25d263127dc2 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.730839 Jul 14 20:35:17.461953 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 38/81] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:16 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:17.469420 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-32fe88b2-93e1-4bda-8c16-b09ce673b5fd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.818125 Jul 14 20:35:17.474511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 44/82] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:16 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:17.475192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:17.476735 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:17.484242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:17.488609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:17.496523 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:17.496998 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:17.498516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:17.499717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:17.522210 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:17.523077 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:17.524879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:17.525542 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.506597 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:18.515076 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b6158b75-5c47-46a5-a166-5bb2536523f5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 1.050378 Jul 14 20:35:18.515647 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 39/83] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:17 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:18.523128 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-a4011cc9-f868-4ef8-a29e-68d2756119f4 req-ff3b9d16-4fa9-48f9-93aa-df1a819e0c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efaa8c98-eb8c-456b-b093-12ac487cfc64", "tag": "ea4dd618-a12a-4809-aad4-c26bb92988bd"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:18.538679 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-a4011cc9-f868-4ef8-a29e-68d2756119f4 req-ff3b9d16-4fa9-48f9-93aa-df1a819e0c08 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:18.543645 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-a4011cc9-f868-4ef8-a29e-68d2756119f4 req-ff3b9d16-4fa9-48f9-93aa-df1a819e0c08 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.554774 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:18.568575 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:18.570182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:18.571681 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8c4cfdf9-5aaa-4752-88bc-08990d6ff79a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 1.095912 Jul 14 20:35:18.572241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 45/84] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:17 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:18.577775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:18.578389 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:18.593358 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-a4011cc9-f868-4ef8-a29e-68d2756119f4 req-ff3b9d16-4fa9-48f9-93aa-df1a819e0c08 service nova] Creating event network-changed:ea4dd618-a12a-4809-aad4-c26bb92988bd for instance efaa8c98-eb8c-456b-b093-12ac487cfc64 on hv-cinder-79987 Jul 14 20:35:18.594077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-a4011cc9-f868-4ef8-a29e-68d2756119f4 req-ff3b9d16-4fa9-48f9-93aa-df1a819e0c08 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124371) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 20:35:18.595386 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b0aad8a-8d37-447d-9af3-5a9bec16d2ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:18.596548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b0aad8a-8d37-447d-9af3-5a9bec16d2ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.597603 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b0aad8a-8d37-447d-9af3-5a9bec16d2ba None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:18.598193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b0aad8a-8d37-447d-9af3-5a9bec16d2ba None None] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.605495 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:18.606151 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.606878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:18.607357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.609510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.compute.rpcapi [None req-4b0aad8a-8d37-447d-9af3-5a9bec16d2ba None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 20:35:18.610597 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b0aad8a-8d37-447d-9af3-5a9bec16d2ba None None] Releasing lock "compute-rpcapi-router" {{(pid=124371) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 20:35:18.615336 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:18.647366 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4b0aad8a-8d37-447d-9af3-5a9bec16d2ba None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129994 Jul 14 20:35:18.648318 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 40/85] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:18.654213 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:18.655225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:18.662783 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:18.663614 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.664684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:18.665461 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:18.898860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:18.916888 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9f033a0c-30ae-45b2-b3b4-e0ab715a0d7d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.343395 Jul 14 20:35:18.919917 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 46/86] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:18 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:18.961887 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:18.973396 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7b790794-d8c4-4e43-b3a4-f63521c81e79 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.323432 Jul 14 20:35:18.983181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 41/87] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:18 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:19.533771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:19.534616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:19.540765 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:19.542170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:19.543126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:19.543712 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:19.590047 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:19.591320 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:19.598601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:19.599351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:19.600315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:19.600735 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:20.353331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:20.367407 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-54af69ce-b5ad-4c14-aa43-4b6bfaf88666 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.838061 Jul 14 20:35:20.367995 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 47/88] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:19 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:20.394558 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:20.396827 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:20.414971 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:20.416896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:20.421054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:20.421585 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:20.454924 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:20.467268 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:20.469541 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:20.471535 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f7281869-4183-4be9-a72d-53af33d50574 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.885020 Jul 14 20:35:20.484558 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 42/89] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:19 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:20.503140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:20.506188 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:20.526689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:20.527183 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:20.539496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:20.539496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:20.808278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:20.819657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-91b07692-aa13-44aa-8b22-3f9023142365 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.439325 Jul 14 20:35:20.820135 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 48/90] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:20 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:20.892238 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:20.910176 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b8aa8651-9b03-40e3-9019-7bc34837a21f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.424188 Jul 14 20:35:20.919788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 43/91] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:20 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:20.919788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-0d0097a5-2828-4a87-aee7-1b5d467e1e34 req-572344c8-6e98-4945-b673-14d859144229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e306d8c2-449e-43db-8e98-53d049726ddc", "tag": "1ac0a834-cdf8-45d5-b1de-b010bb6c8485"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:20.926674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-0d0097a5-2828-4a87-aee7-1b5d467e1e34 req-572344c8-6e98-4945-b673-14d859144229 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:20.927154 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-0d0097a5-2828-4a87-aee7-1b5d467e1e34 req-572344c8-6e98-4945-b673-14d859144229 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:20.948129 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-0d0097a5-2828-4a87-aee7-1b5d467e1e34 req-572344c8-6e98-4945-b673-14d859144229 service nova] Creating event network-changed:1ac0a834-cdf8-45d5-b1de-b010bb6c8485 for instance e306d8c2-449e-43db-8e98-53d049726ddc on hv-cinder-79987 Jul 14 20:35:20.953934 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-0d0097a5-2828-4a87-aee7-1b5d467e1e34 req-572344c8-6e98-4945-b673-14d859144229 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040034 Jul 14 20:35:20.954824 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 44/92] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:21.117682 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-a189c7a3-0eaf-4e8b-bfa9-1bd5a09cf474 req-0da39550-921c-4ed3-bd1f-f9599da875ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e709bc-663e-4241-bdc4-350e7c4d6ce4", "name": "network-vif-plugged", "status": "completed", "tag": "33ce41a8-cfae-480a-8e36-a527518059f8"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:21.126545 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a189c7a3-0eaf-4e8b-bfa9-1bd5a09cf474 req-0da39550-921c-4ed3-bd1f-f9599da875ec service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.127013 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a189c7a3-0eaf-4e8b-bfa9-1bd5a09cf474 req-0da39550-921c-4ed3-bd1f-f9599da875ec service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.139154 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-a189c7a3-0eaf-4e8b-bfa9-1bd5a09cf474 req-0da39550-921c-4ed3-bd1f-f9599da875ec service nova] Creating event network-vif-plugged:33ce41a8-cfae-480a-8e36-a527518059f8 for instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 on hv-cinder-79987 Jul 14 20:35:21.146099 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-a189c7a3-0eaf-4e8b-bfa9-1bd5a09cf474 req-0da39550-921c-4ed3-bd1f-f9599da875ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321293 Jul 14 20:35:21.147059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 49/93] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:21.388302 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:21.389503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:21.413155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.413155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.413155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.413155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.423612 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:21.504173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:21.518593 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:21.537475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.538926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.540076 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.543216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.756593 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:21.764743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-64f67941-fe5f-40d9-882c-2c576549f4f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.383668 Jul 14 20:35:21.766034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 45/94] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:21 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:21.839885 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:21.840688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:21.847916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.848659 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.849601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.850442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.874797 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:21.895336 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:21.902703 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:21.903902 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4aac98ef-5ccb-47f7-9577-36c39ef0aa2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.417744 Jul 14 20:35:21.908800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 50/95] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:21 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:21.928427 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:21.929404 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:21.943990 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.945889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:21.948931 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:21.949616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:22.417627 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:22.448309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0a47b048-fcea-4c60-9a33-2fdd60014f36 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.615456 Jul 14 20:35:22.452752 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 46/96] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:21 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:22.467354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:22.479578 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d117b025-1896-4d53-a5c8-69a6b102f23d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.553591 Jul 14 20:35:22.481521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 51/97] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:21 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:22.783942 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:22.785488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:22.793536 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:22.794401 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:22.795943 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:22.797129 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:22.925767 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:22.927467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:22.934185 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:22.934725 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:22.936051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:22.936697 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:23.423695 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:23.434999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-85821377-839a-4add-9c13-ae88ead0fc5d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.655194 Jul 14 20:35:23.435274 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 47/98] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:22 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:23.469412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:23.470244 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:23.480978 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:23.483308 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:23.484132 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:23.486078 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:23.542167 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:23.568773 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:23.582222 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:23.583695 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ec0ef507-ed1e-4401-bfc4-b7ff19064912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.661980 Jul 14 20:35:23.586322 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 52/99] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:22 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:23.597460 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:23.598556 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:23.612088 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:23.612853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:23.613863 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:23.614502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:24.125750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:24.128771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:24.145366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5a4c1862-949a-49f2-9f13-4a0aba710988 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.557768 Jul 14 20:35:24.146141 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 53/100] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:23 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:24.157687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a177578b-8cbe-47eb-874e-03a9a3b5d44c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.680858 Jul 14 20:35:24.167003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 48/101] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:23 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:24.451934 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:24.452727 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:24.460395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:24.462884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:24.465987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:24.466644 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:24.622281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:24.623577 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:24.648673 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:24.649397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:24.650482 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:24.651173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:24.787464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:24.816379 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-617f45dd-3200-4624-9e11-b83406fe3675 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.368159 Jul 14 20:35:24.817428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 54/102] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:24 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:24.825891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-ae99b5e2-e2b3-445c-b344-115b6fbd8a7f req-03abad11-2f5b-4ace-8b23-9f82c6f8d8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476db6db-4757-4a95-a7b8-7fab0e3f6a68", "name": "network-vif-plugged", "status": "completed", "tag": "1f90d544-e4b7-4775-8f93-61ce62d596b4"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:24.839278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-ae99b5e2-e2b3-445c-b344-115b6fbd8a7f req-03abad11-2f5b-4ace-8b23-9f82c6f8d8c0 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:24.840350 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-ae99b5e2-e2b3-445c-b344-115b6fbd8a7f req-03abad11-2f5b-4ace-8b23-9f82c6f8d8c0 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:24.842294 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:24.856227 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-ae99b5e2-e2b3-445c-b344-115b6fbd8a7f req-03abad11-2f5b-4ace-8b23-9f82c6f8d8c0 service nova] Creating event network-vif-plugged:1f90d544-e4b7-4775-8f93-61ce62d596b4 for instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 on hv-cinder-79987 Jul 14 20:35:24.858589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:24.860250 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:24.861456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f1235d83-2f12-4d5b-a51a-38e90ca26fc7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.245943 Jul 14 20:35:24.862174 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-ae99b5e2-e2b3-445c-b344-115b6fbd8a7f req-03abad11-2f5b-4ace-8b23-9f82c6f8d8c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042822 Jul 14 20:35:24.862538 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 49/103] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:24 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:35:24.864208 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 55/104] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:25.163756 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:25.164377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:25.174733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.175290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:25.176112 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.176561 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:25.179230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:25.181089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:25.192153 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.192905 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:25.193932 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.194866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:25.771696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:25.777894 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:25.786408 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f570ccc5-a9e7-41f1-b26b-ded059c4cb8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.626269 Jul 14 20:35:25.788091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 50/105] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:25 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:25.788216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-19c2cb60-135f-4bfc-b646-3e5b50d94285 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.615124 Jul 14 20:35:25.791688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 56/106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:25 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:25.839471 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:25.840158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:25.874193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.874661 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:25.876513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.876513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:25.882716 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:25.883629 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:25.900493 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.903076 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:25.906999 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:25.908272 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:26.227716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:26.240828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5b7fa199-0c83-46cf-9239-20e8286c6baf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1322 microversion: 2.1 time: 0.408334 Jul 14 20:35:26.243856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 51/107] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:25 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:26.300014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:26.316213 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:26.317992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:26.319179 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d026ea0b-581c-43b8-9bf7-0ecb594da9f7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.440538 Jul 14 20:35:26.319755 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 57/108] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:25 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:35:26.805985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:26.807423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:26.807983 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:26.808586 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:26.816761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:26.817437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:26.818808 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:26.819302 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:26.819439 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:26.820116 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:26.820235 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:26.820653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.039046 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:27.041659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:27.047535 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0f4f8eef-9163-48cc-8f16-5b11c6a65235 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.246846 Jul 14 20:35:27.055473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7679f37d-4559-4ac8-9212-074117a9f7af tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.246072 Jul 14 20:35:27.056390 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 52/109] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:26 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:27.060216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 58/110] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:26 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:27.062201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-39c1dee7-c6f7-4444-ae26-457ec90aa41e req-25a15598-3f7e-4a1a-bc22-55e0bc39671a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad8c60a-cc83-4ab7-beab-7c1a2b31c830", "name": "network-vif-plugged", "status": "completed", "tag": "59599dd6-29f1-4ecf-91d4-36c5c1372812"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:27.072168 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-39c1dee7-c6f7-4444-ae26-457ec90aa41e req-25a15598-3f7e-4a1a-bc22-55e0bc39671a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.072599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-39c1dee7-c6f7-4444-ae26-457ec90aa41e req-25a15598-3f7e-4a1a-bc22-55e0bc39671a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.086339 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-39c1dee7-c6f7-4444-ae26-457ec90aa41e req-25a15598-3f7e-4a1a-bc22-55e0bc39671a service nova] Creating event network-vif-plugged:59599dd6-29f1-4ecf-91d4-36c5c1372812 for instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 on hv-cinder-79987 Jul 14 20:35:27.092287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-39c1dee7-c6f7-4444-ae26-457ec90aa41e req-25a15598-3f7e-4a1a-bc22-55e0bc39671a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034275 Jul 14 20:35:27.093190 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 53/111] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:27.259008 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:27.259561 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:27.273811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.273811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.277609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.278161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.339241 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:27.340191 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:27.347908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.348704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.350488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.351438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.485800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:27.495038 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4283baf1-a51f-45d7-ad00-e605f3f622ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1516 microversion: 2.1 time: 0.240206 Jul 14 20:35:27.507949 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 59/112] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:27 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:27.534206 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:27.538018 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:27.543214 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:27.551207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.551759 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.552641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.553165 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.558274 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:27.560096 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:27.561248 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2fd726de-fcd0-40aa-8144-daecfb17b99d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.228119 Jul 14 20:35:27.571979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 54/113] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:27 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:35:27.644125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lazy-loading 'flavor' on Instance uuid 476db6db-4757-4a95-a7b8-7fab0e3f6a68 {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:35:27.796898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ca869cfa-b2d0-424a-92ac-e70a841607c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68/action" status: 200 len: 32 microversion: 2.1 time: 0.287538 Jul 14 20:35:27.797822 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 60/114] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:35:27 2022] POST /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 20:35:27.807363 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:27.807979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:27.814224 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.814721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:27.815996 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:27.816602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:28.069095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:28.070428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:28.078950 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:28.079743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:28.082379 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:28.083092 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:28.188791 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:28.196728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-12ec5b39-7f05-442d-9f5f-77e4537bbf8e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.393332 Jul 14 20:35:28.204053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 55/115] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:27 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:28.215496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:28.216413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:28.225622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:28.226443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:28.227445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:28.227890 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:28.491379 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:28.505699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-27e8db21-3211-4bba-a9fe-a1aa1e4b154c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.444242 Jul 14 20:35:28.506686 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 61/116] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:28 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:28.548580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:28.557086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3ebce635-a04d-43de-ae2b-082a69517436 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.351655 Jul 14 20:35:28.558992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 56/117] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:28 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:28.579193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:28.579790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:28.597331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:28.599334 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:28.603400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:28.603885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:28.614057 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:28.881414 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:28.890193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:28.891974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:28.893397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e0469a49-d9ff-4ac3-8642-c974f32f591e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.318129 Jul 14 20:35:28.894079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 62/118] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:28 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:29.111053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-edde8749-50de-4dd9-99fa-adc27e7aaaae req-14a2abe8-863f-44f2-bc8f-bdfeae911c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e306d8c2-449e-43db-8e98-53d049726ddc", "name": "network-vif-plugged", "status": "completed", "tag": "1ac0a834-cdf8-45d5-b1de-b010bb6c8485"}, {"server_uuid": "efaa8c98-eb8c-456b-b093-12ac487cfc64", "name": "network-vif-plugged", "status": "completed", "tag": "ea4dd618-a12a-4809-aad4-c26bb92988bd"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:29.118163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:29.150988 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-edde8749-50de-4dd9-99fa-adc27e7aaaae req-14a2abe8-863f-44f2-bc8f-bdfeae911c76 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:29.151442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-edde8749-50de-4dd9-99fa-adc27e7aaaae req-14a2abe8-863f-44f2-bc8f-bdfeae911c76 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:29.165279 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-edde8749-50de-4dd9-99fa-adc27e7aaaae req-14a2abe8-863f-44f2-bc8f-bdfeae911c76 service nova] Creating event network-vif-plugged:1ac0a834-cdf8-45d5-b1de-b010bb6c8485 for instance e306d8c2-449e-43db-8e98-53d049726ddc on hv-cinder-79987 Jul 14 20:35:29.165787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-edde8749-50de-4dd9-99fa-adc27e7aaaae req-14a2abe8-863f-44f2-bc8f-bdfeae911c76 service nova] Creating event network-vif-plugged:ea4dd618-a12a-4809-aad4-c26bb92988bd for instance efaa8c98-eb8c-456b-b093-12ac487cfc64 on hv-cinder-79987 Jul 14 20:35:29.173507 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-edde8749-50de-4dd9-99fa-adc27e7aaaae req-14a2abe8-863f-44f2-bc8f-bdfeae911c76 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066565 Jul 14 20:35:29.175718 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 57/119] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:29.221783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:29.222701 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:29.230435 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:29.231319 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:29.233790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:29.234430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:29.503146 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:29.526375 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:29.527152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:29.537785 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-736d259f-4cff-4dcb-aa56-23152daaf515 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.320272 Jul 14 20:35:29.538388 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 63/120] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:29 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:29.543764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:29.544219 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:29.545003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:29.545519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:29.594954 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:29.597905 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:29.628216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:29.629286 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:29.630111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:29.630554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:29.986925 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:29.996223 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b949d23d-3319-4ad9-91d9-712228fbbd70 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1366 microversion: 2.1 time: 0.473995 Jul 14 20:35:30.000642 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 58/121] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:29 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:30.017235 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:30.023460 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:30.025801 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:30.033478 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:30.034185 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:30.035853 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:30.038947 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8a76f540-493e-49df-9b78-28b41fbd12ef tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.465961 Jul 14 20:35:30.039828 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 64/122] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:29 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:30.046611 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:30.202830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:30.211321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:30.212855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:30.213954 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1907acd4-4892-42b8-94f0-90d026fc11b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.211120 Jul 14 20:35:30.214506 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 59/123] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:30 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:30.555233 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:30.555848 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:30.561961 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:30.562308 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:30.563110 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:30.563556 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:30.696095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:30.703760 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-161f91fd-27d3-4704-839b-ef52eea69aed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.152376 Jul 14 20:35:30.704335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 65/124] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:30 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:31.017258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:31.018378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:31.025273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.026018 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.026794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.027261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.056067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:31.056791 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:31.063278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.063658 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.064430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.065260 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.475499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:31.477107 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:31.488167 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-62b337ae-857c-4425-aac1-49348a9dabe6 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.436136 Jul 14 20:35:31.489444 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 66/125] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:31 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:31.491338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e3956850-bf3f-49b3-b3b3-92d787122c0b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1555 microversion: 2.1 time: 0.477766 Jul 14 20:35:31.493398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 60/126] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:31 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1555 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:31.494712 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:31.495544 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:31.508144 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.508828 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.510704 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.511362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.513231 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2fc236be-f048-4694-9bbd-a2900e0cd760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:31.514831 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2fc236be-f048-4694-9bbd-a2900e0cd760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:31.530267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fc236be-f048-4694-9bbd-a2900e0cd760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.530967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fc236be-f048-4694-9bbd-a2900e0cd760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.532762 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fc236be-f048-4694-9bbd-a2900e0cd760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.533788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2fc236be-f048-4694-9bbd-a2900e0cd760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.700043 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:31.704879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2fc236be-f048-4694-9bbd-a2900e0cd760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198273 Jul 14 20:35:31.711793 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 61/127] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:35:31 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:31.713305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:31.714885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:31.716581 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-19af133a-308e-4c7d-bca1-e936f4168943 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.225924 Jul 14 20:35:31.717226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 67/128] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:31 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:31.720851 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:31.721601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:31.728280 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.728741 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.729519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:31.729960 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:31.896640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:31.906959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-04afc5b1-a12d-4140-93db-601f73b1c79f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.189268 Jul 14 20:35:31.907790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 62/129] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:31 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:32.505553 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:32.506480 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:32.515540 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:32.516824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:32.520135 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:32.520825 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:32.730868 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:32.734469 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:32.735120 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:32.741326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-63a5b378-7197-4816-84fc-2afd8e1a391d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.239763 Jul 14 20:35:32.741810 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:32.742366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 68/130] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:32 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:32.742863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:32.743753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:32.744268 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:32.924857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:32.925563 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:32.934775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:32.935445 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:32.936599 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:32.937240 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:32.942248 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:32.944764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:32.954287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:32.956643 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:32.957772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-56b068ed-bc50-467a-aeaa-73d658293dcc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.227266 Jul 14 20:35:32.958353 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 63/131] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:32 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:35:33.087959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:33.095812 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-686c47d8-3f60-49dd-a31a-aa7c2786fdb5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.175501 Jul 14 20:35:33.096393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 69/132] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:32 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:33.312637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-9e75c5c6-205b-47c1-bc17-bc0d79e2d4e7 req-3597bc09-ad04-40e9-8579-c15437c09071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad8c60a-cc83-4ab7-beab-7c1a2b31c830", "tag": "59599dd6-29f1-4ecf-91d4-36c5c1372812"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:33.321955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-9e75c5c6-205b-47c1-bc17-bc0d79e2d4e7 req-3597bc09-ad04-40e9-8579-c15437c09071 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:33.322499 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-9e75c5c6-205b-47c1-bc17-bc0d79e2d4e7 req-3597bc09-ad04-40e9-8579-c15437c09071 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:33.336346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-9e75c5c6-205b-47c1-bc17-bc0d79e2d4e7 req-3597bc09-ad04-40e9-8579-c15437c09071 service nova] Creating event network-changed:59599dd6-29f1-4ecf-91d4-36c5c1372812 for instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 on hv-cinder-79987 Jul 14 20:35:33.342847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-9e75c5c6-205b-47c1-bc17-bc0d79e2d4e7 req-3597bc09-ad04-40e9-8579-c15437c09071 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033749 Jul 14 20:35:33.344176 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 64/133] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:35:33.759603 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:33.760254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:33.768624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:33.769300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:33.770284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:33.771197 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:33.951237 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:33.962568 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-394c72ba-47e5-49b0-9ef0-1a6a9cd32f31 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.207253 Jul 14 20:35:33.964023 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 70/134] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:33 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:33.980012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:33.980864 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:33.990514 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:33.991175 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:33.992146 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:33.992540 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:34.113962 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:34.114580 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:34.124913 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:34.125374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:34.127881 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:34.128341 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:34.151951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:34.160809 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:34.163443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:34.164566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a901f675-2f21-4434-bbd9-23ee30b0ff0d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.190635 Jul 14 20:35:34.168636 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 65/135] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:33 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:34.307594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:34.316045 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-df66f984-ecf6-42a5-80ab-73ae3cc7146d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.206878 Jul 14 20:35:34.316702 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 71/136] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:34 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:34.980292 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:34.980904 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:34.988699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:34.989403 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:34.990185 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:34.990614 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:35.134278 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:35.161447 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-58035d68-c36b-4d74-8608-df3ff4598fca tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.184971 Jul 14 20:35:35.162408 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 66/137] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:34 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:35.185977 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:35.186722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:35.194074 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:35.194600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:35.195805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:35.196249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:35.333468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:35.334088 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:35.335330 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:35.340101 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:35.340556 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:35.341338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:35.341776 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:35.343906 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:35.353659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:35.356465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b299bb1a-908d-49b6-94a4-f039ebaf6e62 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.173681 Jul 14 20:35:35.357818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 72/138] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:35 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:35.507462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:35.515371 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d23313ee-8c30-4ef0-a0a1-146be9a72cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.185758 Jul 14 20:35:35.516051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 67/139] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:35 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:36.178307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:36.178921 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:36.185093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:36.185538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:36.186306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:36.186851 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:36.348809 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:36.356748 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-041f7882-a4ce-4979-a17a-1791ac51d555 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.182924 Jul 14 20:35:36.357637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 73/140] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:36 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:36.374493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:36.375125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:36.381910 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:36.382263 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:36.383092 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:36.383681 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:36.522025 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:36.531158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:36.533848 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:36.534088 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:36.534957 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:36.535251 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cd8e84d5-1acf-42dc-9eb9-caee97810a08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.164401 Jul 14 20:35:36.535857 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 68/141] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:36 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:36.556221 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:36.556684 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:36.558031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:36.558031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:36.743292 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:36.751026 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8f29d285-cd5f-42b0-b9fd-50998d1927f4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.221398 Jul 14 20:35:36.751887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 74/142] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:36 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:37.373656 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:37.374624 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:37.386341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:37.387992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:37.389639 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:37.394914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:37.556181 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:37.558253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:37.567722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=94 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:37.570230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:37.570892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:37.572007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:37.572830 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:37.660592 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:37.672029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0502f7db-353d-4f7a-84e2-b6b82030d04c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1314 microversion: 2.1 time: 0.301886 Jul 14 20:35:37.672761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 69/143] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:37 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:37.769367 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:37.770222 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:37.777566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:37.778096 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:37.778971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:37.779458 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:37.930853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:37.940592 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:37.942190 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:37.943695 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-de820988-3c28-4204-a853-ce562d8a4716 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1408 microversion: 2.20 time: 0.394749 Jul 14 20:35:37.954548 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 75/144] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:37 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1408 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:35:38.041850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:38.051963 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-950933d7-cde3-48b5-b6f0-c7cd1efeb45c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.287333 Jul 14 20:35:38.054987 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 70/145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:37 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:38.690429 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:38.691202 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:38.697655 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:38.698209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:38.698966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:38.699463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:38.878809 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:38.886197 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2f84b829-e626-470d-b18a-91dce0ca50e3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1500 microversion: 2.1 time: 0.200506 Jul 14 20:35:38.886765 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 76/146] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:38 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1500 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:38.962660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:38.963326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:38.972377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:38.972765 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:38.973559 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:38.974026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:39.071552 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:39.072450 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:39.078759 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:39.080344 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:39.084177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:39.084634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:39.232001 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:39.245971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:39.247514 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:39.248919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a3acbdfc-be85-420f-a439-897fb657993a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1600 microversion: 2.20 time: 0.290957 Jul 14 20:35:39.250014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 71/147] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:35:38 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1600 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:35:39.271818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-66ae4d49-a641-4122-a7e1-edeb5727ded9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:39.272525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-66ae4d49-a641-4122-a7e1-edeb5727ded9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:39.281475 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66ae4d49-a641-4122-a7e1-edeb5727ded9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:39.281684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66ae4d49-a641-4122-a7e1-edeb5727ded9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:39.282467 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66ae4d49-a641-4122-a7e1-edeb5727ded9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:39.283141 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66ae4d49-a641-4122-a7e1-edeb5727ded9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:39.654118 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-66ae4d49-a641-4122-a7e1-edeb5727ded9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.388336 Jul 14 20:35:39.655146 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 72/148] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Jul 14 20:35:39 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-interface => generated 285 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:35:39.692028 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:39.700281 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c702c289-cb31-45a9-85d5-c362ba8b9ca6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.633788 Jul 14 20:35:39.710191 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 77/149] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:39 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:40.532856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ca85d228-2554-426d-aa24-d7199a1fa9c8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55c35571-f7f3-48db-9a54-87f4f74bc1ed"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:40.534009 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ca85d228-2554-426d-aa24-d7199a1fa9c8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:40.540051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=90 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:40.542218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca85d228-2554-426d-aa24-d7199a1fa9c8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:40.542849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca85d228-2554-426d-aa24-d7199a1fa9c8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:40.543652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca85d228-2554-426d-aa24-d7199a1fa9c8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:40.544237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca85d228-2554-426d-aa24-d7199a1fa9c8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:40.717610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:40.718216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:40.731304 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:40.731756 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:40.732536 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:40.732973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:40.890458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:40.893952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:40.899402 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1c3b2ec0-44c8-4d9c-8f11-ad7d009099e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.185487 Jul 14 20:35:40.899904 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 78/150] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:40 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:40.954381 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-fa81c90d-c459-4aca-9a38-608894baa0d0 req-19f88a19-ab89-4b72-b8c5-25a1137645d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e306d8c2-449e-43db-8e98-53d049726ddc", "tag": "1ac0a834-cdf8-45d5-b1de-b010bb6c8485"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:35:40.963842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-fa81c90d-c459-4aca-9a38-608894baa0d0 req-19f88a19-ab89-4b72-b8c5-25a1137645d6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:40.964369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-fa81c90d-c459-4aca-9a38-608894baa0d0 req-19f88a19-ab89-4b72-b8c5-25a1137645d6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:40.975906 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-fa81c90d-c459-4aca-9a38-608894baa0d0 req-19f88a19-ab89-4b72-b8c5-25a1137645d6 service nova] Creating event network-changed:1ac0a834-cdf8-45d5-b1de-b010bb6c8485 for instance e306d8c2-449e-43db-8e98-53d049726ddc on hv-cinder-79987 Jul 14 20:35:40.982304 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-fa81c90d-c459-4aca-9a38-608894baa0d0 req-19f88a19-ab89-4b72-b8c5-25a1137645d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031987 Jul 14 20:35:40.983245 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 79/151] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:41.917641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:41.918357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:41.926152 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:41.926819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:41.928037 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:41.928668 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:42.123569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:42.133070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7ae29cfc-9605-4c62-af93-6c47148e4c94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.219579 Jul 14 20:35:42.134382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 80/152] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:41 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:43.150966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:43.151595 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:43.157725 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:43.158173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:43.158962 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:43.160543 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:43.441512 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:43.460126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6a100bee-0b86-4e6c-b15b-0e9dfe50d858 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.312914 Jul 14 20:35:43.462651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 81/153] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:43 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:43.541310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ca85d228-2554-426d-aa24-d7199a1fa9c8 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "POST /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.012181 Jul 14 20:35:43.541949 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 73/154] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:35:40 2022] POST /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64/os-volume_attachments => generated 194 bytes in 3014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:35:44.479517 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:44.480227 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:44.487420 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:44.487893 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:44.488706 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:44.489136 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:44.628858 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:44.636649 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8c33ee93-0158-4293-9a9f-8c0a0f041a27 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.160961 Jul 14 20:35:44.647682 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 82/155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:44 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:45.655693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:45.656324 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:45.664876 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:45.665321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:45.666091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:45.666524 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:45.801544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:45.809142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-18a27795-6f5a-4b46-a666-913f6e35f3a7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.158271 Jul 14 20:35:45.809747 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 74/156] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:45 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:46.825312 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:46.825921 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:46.832179 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:46.832519 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:46.833290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:46.833733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:46.962580 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:46.969985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5bf02d83-c323-4232-a604-12eeb4b8c07a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.148422 Jul 14 20:35:46.970547 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 83/157] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:46 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:47.986689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:47.987318 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:47.993828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:47.994292 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:47.995083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:47.995522 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:48.124630 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:48.132678 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-072afe1e-5f53-4dfc-a1ea-38f9492a54f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.149860 Jul 14 20:35:48.133241 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 75/158] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:47 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:49.149258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:49.149784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:49.155839 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:49.156280 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:49.157036 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:49.157464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:49.282250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:49.289664 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b70c6f5b-b5e2-4fd3-a5d7-cedd2bc7cb26 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.144615 Jul 14 20:35:49.290224 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 84/159] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:49 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:50.306644 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:50.307207 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:50.313654 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:50.314145 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:50.315422 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:50.315853 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:50.447338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:50.454714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8984c440-8041-4ee7-bc2f-c2acbc04e921 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.152000 Jul 14 20:35:50.455580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 76/160] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:50 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:51.472754 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:51.473366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:51.479636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:51.480083 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:51.480849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:51.481278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:51.622205 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:51.629747 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-868592fb-bc8e-49f1-82e9-aa8eb94de580 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.161681 Jul 14 20:35:51.630617 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 85/161] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:51 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:52.647709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:52.648448 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:52.655398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:52.655852 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:52.656632 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:52.657066 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:52.793950 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:52.802724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1d8c981d-72f6-41a3-8196-f6f940862a3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.159051 Jul 14 20:35:52.803359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 77/162] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:52 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:53.820694 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:53.821219 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:53.827323 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:53.827773 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:53.828536 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:53.828971 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:53.956409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:53.963932 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-81496f25-4c69-4434-b690-ba50ed373425 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.147150 Jul 14 20:35:53.964505 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 86/163] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:53 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:54.981361 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:54.982013 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:54.989515 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:54.989966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:54.990745 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:54.991208 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:55.123381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:55.131921 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f5181152-0606-4945-bb96-63b549b0eb6d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.154395 Jul 14 20:35:55.132488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 78/164] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:54 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:56.155653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:56.157429 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:56.164991 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:56.165888 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:56.167372 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:56.168149 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:56.332250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:56.351413 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2bba4a32-5542-41c3-b25e-519ec2046637 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.205441 Jul 14 20:35:56.352007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 87/165] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:56 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:57.368706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:57.369322 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:57.376415 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:57.376865 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:57.377652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:57.378086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:57.555093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:57.563284 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0852d2d2-1ec6-4e46-8eda-52f9f3a51a6e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.198857 Jul 14 20:35:57.563871 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 79/166] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:57 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:35:58.581481 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:58.582096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:58.591468 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:58.592008 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:58.592815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:58.598684 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:58.787330 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:58.795620 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-bfa6af65-d5dc-4197-9f43-341b2530f19a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.218523 Jul 14 20:35:58.796126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 88/167] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:58 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:35:59.817575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:35:59.818226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:35:59.824702 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:59.825156 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:59.825936 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:35:59.826378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:35:59.829269 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:35:59.971290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:35:59.978971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0530ecdd-36f6-4889-a507-d7918682afcb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.165213 Jul 14 20:35:59.979530 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 80/168] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:35:59 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:00.995823 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:00.996437 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:01.002434 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:01.002885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:01.003688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:01.004123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:01.158294 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:01.167226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-75dee7ff-a36f-4ae1-95bf-a8387a5e1af8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.175107 Jul 14 20:36:01.167819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 89/169] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:00 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:02.184353 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:02.185174 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:02.192537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:02.193062 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:02.193832 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:02.194285 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:02.344968 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:02.354148 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b30c400a-81e8-4f20-83fa-ebb0166837f9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1522 microversion: 2.1 time: 0.174066 Jul 14 20:36:02.354734 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 81/170] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:02 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:03.372591 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:03.374524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:03.381838 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:03.382746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:03.383808 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:03.384624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:03.592512 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:03.600640 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8bb8d604-81c2-44b6-9123-3d771d4c4eaf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1502 microversion: 2.1 time: 0.232639 Jul 14 20:36:03.601433 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 90/171] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:03 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:03.617293 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:03.617912 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:03.624195 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:03.624647 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:03.625430 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:03.625899 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:03.799442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:03.808744 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b106a807-2d1f-481b-afc0-045aaf6a1039 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1515 microversion: 2.1 time: 0.195975 Jul 14 20:36:03.809359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 82/172] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:03 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:05.036663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:05.037154 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:05.043855 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.044625 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.045401 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.045834 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.074909 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:36:05.197087 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6b1e71a3-d665-4f31-8142-c28f637aea6d tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 204 len: 0 microversion: 2.1 time: 0.164609 Jul 14 20:36:05.197836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 91/173] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:36:05 2022] DELETE /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:36:05.216707 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:05.217328 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:05.225186 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.226488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.227577 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.227856 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:05.228318 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.229292 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:05.237743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.238193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.239401 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.239844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.265613 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lazy-loading 'flavor' on Instance uuid 44e709bc-663e-4241-bdc4-350e7c4d6ce4 {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:36:05.336587 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:05.363895 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-02a7a792-f7ca-497d-b472-2e0442344c72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4/action" status: 200 len: 32 microversion: 2.1 time: 0.142884 Jul 14 20:36:05.364710 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 92/174] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:36:05 2022] POST /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 20:36:05.374083 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:05.374794 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:05.381800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.382366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.383228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:05.383672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:05.387955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:05.399662 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d07672d2-7313-4f3d-8d3f-02315eaeaad3 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1552 microversion: 2.1 time: 0.197260 Jul 14 20:36:05.410033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 83/175] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:05 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1552 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:05.530238 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:05.547910 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d5a078ba-fdd2-4336-8bc6-e49e66f453f1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.177814 Jul 14 20:36:05.548514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 93/176] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:05 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:06.418181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:06.418798 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:06.437455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:06.438055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:06.439174 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:06.440950 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:06.566086 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:06.566926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:06.588349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:06.591516 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:06.594107 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:06.596039 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:06.631909 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:06.638738 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cbb12540-6d80-4283-9f31-3a6aa4bdeef9 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1552 microversion: 2.1 time: 0.224613 Jul 14 20:36:06.639913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 84/177] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:06 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:06.795239 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:06.803725 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-63399a25-2e64-44a2-b805-45e6255cba5c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.242435 Jul 14 20:36:06.804810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 94/178] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:06 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:07.657014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:07.657719 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:07.665437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:07.666023 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:07.666969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:07.667562 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:07.827805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:07.830212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:07.836103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:07.843276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:07.844896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:07.846321 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:07.846956 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:08.447125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:08.457307 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e3eedd47-e710-4958-8f2c-da71f00b7fb1 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1552 microversion: 2.1 time: 0.804022 Jul 14 20:36:08.458136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 85/179] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:07 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1552 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:08.680944 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:08.693576 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f6ca4449-1615-48da-88e0-9aa90c204cfc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.872660 Jul 14 20:36:08.694791 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 95/180] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:07 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:09.149150 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-f33623b6-1e67-4d05-9245-21756b359e53 req-425303d8-d2f8-44dc-ab7a-cfc4da1bdefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efaa8c98-eb8c-456b-b093-12ac487cfc64", "name": "network-vif-deleted", "tag": "ea4dd618-a12a-4809-aad4-c26bb92988bd"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:09.176192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-f33623b6-1e67-4d05-9245-21756b359e53 req-425303d8-d2f8-44dc-ab7a-cfc4da1bdefb service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:09.176831 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-f33623b6-1e67-4d05-9245-21756b359e53 req-425303d8-d2f8-44dc-ab7a-cfc4da1bdefb service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:09.195599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-f33623b6-1e67-4d05-9245-21756b359e53 req-425303d8-d2f8-44dc-ab7a-cfc4da1bdefb service nova] Creating event network-vif-deleted:ea4dd618-a12a-4809-aad4-c26bb92988bd for instance efaa8c98-eb8c-456b-b093-12ac487cfc64 on hv-cinder-79987 Jul 14 20:36:09.202537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-f33623b6-1e67-4d05-9245-21756b359e53 req-425303d8-d2f8-44dc-ab7a-cfc4da1bdefb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057826 Jul 14 20:36:09.203406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 86/181] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:36:09.474869 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:09.475652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:09.481713 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:09.482389 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:09.483471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:09.484044 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:09.557376 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fdc04cfa44f4a21a1ce9854fd43c068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccdb0dd0a034f008329f489ed3f7d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:09.565988 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-75dea59c-b5f6-488a-b3e6-5ed359abf7bd tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 200 len: 1345 microversion: 2.1 time: 0.095381 Jul 14 20:36:09.566778 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 96/182] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:09 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:09.720143 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:09.723250 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:09.732410 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:09.732919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:09.734139 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:09.734497 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:09.889509 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:09.899005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b432992e-a3ff-4877-9b7a-bc7d78186c45 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.183663 Jul 14 20:36:09.899601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 87/183] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:09 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:10.583204 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:10.583813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:10.590981 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:10.591384 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:10.592161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:10.592753 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:10.608395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] HTTP exception thrown: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Request method failure captured: Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 HTTP/1.1 Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3oQ5LdTFupnOcOZkc8tzh86rTYnu7wVA03TdtSN5iguevFQRYNMe13_BtGMEZU5qEvaOKj4D41Bwx6nNvqf9hn4C2LC_6ZmNCKQ3G9IEadWGfiRrVHCJlDVG5DVzfmy-2fFLovAKJLnq2pUMaxQEjGcOec16OkgZQ_M-XgyJJZrwA Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:36:10.617739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ccdb0dd0a034f008329f489ed3f7d4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 2fdc04cfa44f4a21a1ce9854fd43c068 Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:10.619271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'efaa8c98-eb8c-456b-b093-12ac487cfc64'} Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:36:10.620285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:10.621471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:10.622473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Returning 404 to user: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:36:10.622473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d4f32f65-1038-4848-a5cf-c54f510b371c tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 404 len: 111 microversion: 2.1 time: 0.039988 Jul 14 20:36:10.622473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 97/184] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:10 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:36:10.916698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:10.918096 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:10.921574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=30 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:10.931300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:10.932784 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:10.933965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:10.934577 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:10.958217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:10.959465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:10.973045 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:10.973616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:10.974521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:10.975699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:11.021815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] HTTP exception thrown: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Request method failure captured: Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64/os-volume_attachments HTTP/1.1 Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3oQ5LdTFupnOcOZkc8tzh86rTYnu7wVA03TdtSN5iguevFQRYNMe13_BtGMEZU5qEvaOKj4D41Bwx6nNvqf9hn4C2LC_6ZmNCKQ3G9IEadWGfiRrVHCJlDVG5DVzfmy-2fFLovAKJLnq2pUMaxQEjGcOec16OkgZQ_M-XgyJJZrwA Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:36:11.031489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ccdb0dd0a034f008329f489ed3f7d4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 2fdc04cfa44f4a21a1ce9854fd43c068 Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:11.033520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'server_id': 'efaa8c98-eb8c-456b-b093-12ac487cfc64'} Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:36:11.034362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:11.035689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:36:11.036733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Returning 404 to user: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:36:11.036733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-795c7821-c928-4900-99e4-0f8b1adb777e tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.082915 Jul 14 20:36:11.041056 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 98/185] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:36:10 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64/os-volume_attachments => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:36:11.204171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:11.216442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-92df8e5d-3cd8-4237-a1aa-d901f3cd4e54 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.303322 Jul 14 20:36:11.217830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 88/186] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:10 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:12.239689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:12.240351 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:12.249977 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:12.250718 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:12.251677 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:12.252207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:12.462203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:12.462709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:12.474066 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:12.474510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:12.475320 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:12.475761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:12.511417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] HTTP exception thrown: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Request method failure captured: Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 HTTP/1.1 Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3oQ5LdTFupnOcOZkc8tzh86rTYnu7wVA03TdtSN5iguevFQRYNMe13_BtGMEZU5qEvaOKj4D41Bwx6nNvqf9hn4C2LC_6ZmNCKQ3G9IEadWGfiRrVHCJlDVG5DVzfmy-2fFLovAKJLnq2pUMaxQEjGcOec16OkgZQ_M-XgyJJZrwA Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:36:12.516346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ccdb0dd0a034f008329f489ed3f7d4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 2fdc04cfa44f4a21a1ce9854fd43c068 Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.518264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'efaa8c98-eb8c-456b-b093-12ac487cfc64'} Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:36:12.518908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.520014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.521046 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Returning 404 to user: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:36:12.522925 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ee1d5c34-d8f0-456d-a2dc-d0a3f6bfad34 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 404 len: 111 microversion: 2.1 time: 0.064356 Jul 14 20:36:12.526661 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 89/187] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:36:12 2022] DELETE /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:36:12.533216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:12.540634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:12.541420 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] [instance: efaa8c98-eb8c-456b-b093-12ac487cfc64] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:12.554683 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-227777f8-8d66-4861-9f2e-bbe6d57d3fdc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.322416 Jul 14 20:36:12.556107 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 99/188] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:12 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:12.575060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:12.576493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:12.577361 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:12.578135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:12.607775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] HTTP exception thrown: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Request method failure captured: Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 HTTP/1.1 Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3oQ5LdTFupnOcOZkc8tzh86rTYnu7wVA03TdtSN5iguevFQRYNMe13_BtGMEZU5qEvaOKj4D41Bwx6nNvqf9hn4C2LC_6ZmNCKQ3G9IEadWGfiRrVHCJlDVG5DVzfmy-2fFLovAKJLnq2pUMaxQEjGcOec16OkgZQ_M-XgyJJZrwA Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:36:12.612142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ccdb0dd0a034f008329f489ed3f7d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ccdb0dd0a034f008329f489ed3f7d4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 7ccdb0dd0a034f008329f489ed3f7d4d Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-DeleteServersTestJSON-263951726 Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 2fdc04cfa44f4a21a1ce9854fd43c068 Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-DeleteServersTestJSON-263951726-project Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.613384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'efaa8c98-eb8c-456b-b093-12ac487cfc64'} Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:36:12.614070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. Jul 14 20:36:12.615742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:12.617264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] Returning 404 to user: Instance efaa8c98-eb8c-456b-b093-12ac487cfc64 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:36:12.617264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-bbf068dd-fb29-4f56-b5ba-7d7b77375796 tempest-DeleteServersTestJSON-263951726 tempest-DeleteServersTestJSON-263951726-project] 10.222.0.52 "GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64" status: 404 len: 111 microversion: 2.1 time: 0.086855 Jul 14 20:36:12.624313 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 90/189] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:12 2022] GET /compute/v2.1/servers/efaa8c98-eb8c-456b-b093-12ac487cfc64 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:36:13.574818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:13.575474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:13.582071 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:13.582582 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:13.583608 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:13.585726 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:13.897325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:13.912406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1cfcd2ef-ce04-465e-a245-6fb01cb54717 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.342633 Jul 14 20:36:13.922085 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 100/190] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:13 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:14.931907 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:14.932603 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:14.942124 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:14.945813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:14.946812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:14.949065 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:15.197682 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:15.208497 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c442f390-155b-44e0-99ea-2b46b2a20246 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.280331 Jul 14 20:36:15.211133 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 91/191] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:14 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:16.225247 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:16.225994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:16.244585 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:16.245047 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:16.245924 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:16.247160 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:16.470869 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:16.479689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cf080c2a-9f68-49b0-905d-c23513e162d3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.258085 Jul 14 20:36:16.483067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 101/192] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:16 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:17.496260 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:17.497416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:17.503916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:17.504561 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:17.505337 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:17.505864 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:17.873332 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:17.885860 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a111358c-ec62-43bf-98ba-b2f0bb2d5060 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.393067 Jul 14 20:36:17.887142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 92/193] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:17 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:18.904120 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:18.904863 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:18.912272 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:18.912844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:18.913692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:18.914333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:19.063148 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:19.073867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f183647b-2128-401e-bf98-ead59e6ddbfb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.173898 Jul 14 20:36:19.074443 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 102/194] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:18 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:20.094837 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:20.096777 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:20.108418 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:20.111290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:20.113700 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:20.115121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:20.310982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:20.319303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8d032969-d3e7-4c6a-bd58-d57e728a375f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.228911 Jul 14 20:36:20.319877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 93/195] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:20 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:21.338047 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:21.339530 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:21.347637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:21.349232 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:21.350299 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:21.350918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:21.606801 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:21.618041 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ac3874ef-6c8b-47c6-83d0-795017f88a94 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.284147 Jul 14 20:36:21.618720 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 103/196] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:21 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:22.634879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:22.636093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:22.644276 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:22.645031 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:22.646093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:22.646967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:22.685987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-413607539", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:22.744584 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] validate_networks() for None {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:36:22.968290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:22.979589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c0e905de-9203-4b0a-8ee6-8c6287701649 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.348321 Jul 14 20:36:22.980549 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 94/197] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:22 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:23.215160 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:36:23.215941 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:36:23.216655 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:36:23.217281 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:36:23.217885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:36:23.231059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:23.231729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:23.233170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:23.234486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:23.255707 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Getting quotas for project 3c1e417367fe41c9943a8b2297742120. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:36:23.260735 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Getting quotas for user c80784a1d58a4b9186636b37d186a739 and project 3c1e417367fe41c9943a8b2297742120. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:36:23.275666 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:36:23.278449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:36:23.340152 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a7e41181-0114-4b44-bb59-f4031d4f0c7c tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662714 Jul 14 20:36:23.341153 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 104/198] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:36:23.355029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9db2ebeb-725f-4362-bbaf-cf22d1e1c12e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:23.355640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9db2ebeb-725f-4362-bbaf-cf22d1e1c12e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:23.422267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9db2ebeb-725f-4362-bbaf-cf22d1e1c12e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:23.431913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9db2ebeb-725f-4362-bbaf-cf22d1e1c12e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1214 microversion: 2.1 time: 0.080753 Jul 14 20:36:23.441165 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 95/199] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:23 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:23.999444 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:24.000050 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:24.006069 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:24.006521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:24.007314 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:24.007751 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:24.141796 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:24.150242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1c0bc101-4148-4f8f-a119-cf194bfe4b20 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.154749 Jul 14 20:36:24.150806 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 105/200] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:23 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:24.451329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:24.451934 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:24.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:24.459658 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:24.460434 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:24.460861 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:24.547805 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:24.556544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-330367b1-e734-44e3-9ec2-2a8272d147e1 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1266 microversion: 2.1 time: 0.109012 Jul 14 20:36:24.557113 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 96/201] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:24 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:25.169478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:25.170666 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:25.177436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.177892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.178668 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.179133 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.328415 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:25.336957 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f19e5ed1-5d2f-4000-bf3d-2b517b7ed259 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1501 microversion: 2.1 time: 0.172382 Jul 14 20:36:25.337542 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 106/202] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:25 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:25.353160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c00c0c51-33d4-4cb2-9f8b-0bc7dffd6765"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:25.354290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:25.360917 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.361423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.362160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.362594 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.386792 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] HTTP exception thrown: Cannot 'attach_volume' instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 while it is in vm_state rescued Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Request method failure captured: Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: POST /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4/os-volume_attachments HTTP/1.1 Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 74 Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3kAdV8bnoIbkfi3zXPBwAE-Yhbyqz8yki4CrvyyCbj9qY6qD9JQ8NtTQx2D1a3lJ6Ytd_IJmAAVrbrIUoqOcPSQpsgj1kCVNQo1wrmQ7oP6MGyR9evbAASgPVUvR79k9mFnfITuGEcMvh9oql-AzkgZkHKstC8gQMMiRaotA1vIfw Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:36:25.388906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cceb4db55bba4bd099104acdcb6d2762", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 765c911957bd4ca68dd520fc4fbba1c9 Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {"volumeAttachment": {"volumeId": "c00c0c51-33d4-4cb2-9f8b-0bc7dffd6765"}} Jul 14 20:36:25.390416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Cannot 'attach_volume' instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 while it is in vm_state rescued Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'server_id': '44e709bc-663e-4241-bdc4-350e7c4d6ce4', 'body': {'volumeAttachment': {'volumeId': 'c00c0c51-33d4-4cb2-9f8b-0bc7dffd6765'}}} Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:36:25.391346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 while it is in vm_state rescued Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:25.393152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:25.394163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:36:25.394163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:36:25.394163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 while it is in vm_state rescued Jul 14 20:36:25.394163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:25.394163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Returning 409 to user: Cannot 'attach_volume' instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 while it is in vm_state rescued {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:36:25.394163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6b28ad6b-fe4b-4883-a70f-315e78184c71 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041166 Jul 14 20:36:25.395349 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 97/203] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:36:25 2022] POST /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 20:36:25.403896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-fa2cff49-0ef3-489f-9c1c-16ecee45ef39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:25.405307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-fa2cff49-0ef3-489f-9c1c-16ecee45ef39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:25.413820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa2cff49-0ef3-489f-9c1c-16ecee45ef39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.414274 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa2cff49-0ef3-489f-9c1c-16ecee45ef39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.415079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa2cff49-0ef3-489f-9c1c-16ecee45ef39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.415516 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa2cff49-0ef3-489f-9c1c-16ecee45ef39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.494646 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-fa2cff49-0ef3-489f-9c1c-16ecee45ef39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.097902 Jul 14 20:36:25.495459 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 107/204] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:36:25 2022] POST /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:36:25.504290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:25.504897 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:25.511437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.511882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.512651 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.513091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.575834 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:25.576805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:25.584164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.584815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.585737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:25.586521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:25.672096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:25.681708 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8706f7ec-3b3f-49df-8b56-9f01f2c7b651 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1266 microversion: 2.1 time: 0.110072 Jul 14 20:36:25.682868 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 108/205] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:25 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:25.729394 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:25.740692 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-db51ac4e-0566-4349-be34-c9e658acfe1a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1509 microversion: 2.1 time: 0.240768 Jul 14 20:36:25.741794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 98/206] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:25 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:26.700926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:26.701476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:26.714030 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:26.714955 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:26.715945 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:26.716822 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:26.758733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:26.759969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:26.768219 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:26.768919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:26.769853 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:26.770438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:26.785315 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:26.792984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-98ce556f-bd49-448f-aaac-17d6415368e3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1266 microversion: 2.1 time: 0.096554 Jul 14 20:36:26.794142 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 109/207] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:26 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:26.920386 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:26.929069 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f3c32dc3-7eb6-4cc7-b646-0c9097baaad2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1509 microversion: 2.1 time: 0.174452 Jul 14 20:36:26.929641 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 99/208] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:26 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:27.809695 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:27.810375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:27.816747 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:27.817310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:27.818164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:27.818605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:27.842407 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:27.917756 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:27.926303 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e40d9f4e-ca53-47a5-a9e1-f3c2d3da259e tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1266 microversion: 2.1 time: 0.120451 Jul 14 20:36:27.927327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 110/209] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:27 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:27.951996 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:27.953210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:27.961889 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:27.962593 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:27.963580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:27.964173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:27.969544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:28.200907 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:28.211140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-36fe8468-87bb-45a6-b550-df70ca393c1d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1509 microversion: 2.1 time: 0.268886 Jul 14 20:36:28.213009 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 100/210] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:27 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:28.648815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-70e97b68-40ff-4452-93fd-015833ad6efb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:28.649231 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-70e97b68-40ff-4452-93fd-015833ad6efb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:28.655621 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-70e97b68-40ff-4452-93fd-015833ad6efb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:28.656069 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-70e97b68-40ff-4452-93fd-015833ad6efb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:28.656846 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-70e97b68-40ff-4452-93fd-015833ad6efb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:28.657517 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-70e97b68-40ff-4452-93fd-015833ad6efb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:28.689310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-70e97b68-40ff-4452-93fd-015833ad6efb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/ips" status: 200 len: 148 microversion: 2.1 time: 0.044721 Jul 14 20:36:28.690554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 111/211] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:36:28 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:36:28.946880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:28.948492 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:28.981001 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:28.981602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:28.983303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:28.984882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:29.229848 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:29.231588 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:29.237903 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:29.253186 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:29.254682 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:29.261743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:29.262597 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9daf76e9-605b-4ef0-95fc-fa58b915dfa3 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1272 microversion: 2.1 time: 0.318109 Jul 14 20:36:29.263322 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:29.265355 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 101/212] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:28 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:29.767988 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:29.776931 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cf074608-ff3a-4491-ad55-c6760a6fcaed tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1509 microversion: 2.1 time: 0.552251 Jul 14 20:36:29.777790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 112/213] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:29 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1509 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:30.281794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:30.285800 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:30.296878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:30.297679 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:30.299254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:30.300190 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:30.404991 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3e17ef00-9ba8-41e7-80bc-f1f8720191e2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c08d7c2d-06af-4f9d-bc90-a68f11c7fe06"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:30.406805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3e17ef00-9ba8-41e7-80bc-f1f8720191e2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:30.413612 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e17ef00-9ba8-41e7-80bc-f1f8720191e2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:30.414387 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e17ef00-9ba8-41e7-80bc-f1f8720191e2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:30.415369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e17ef00-9ba8-41e7-80bc-f1f8720191e2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:30.415949 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e17ef00-9ba8-41e7-80bc-f1f8720191e2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:30.643744 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:30.663318 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8d5c327f-1dbb-45e5-9450-24dd5884e20b tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.382496 Jul 14 20:36:30.664246 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 102/214] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:30 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:30.795788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:30.796857 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:30.806501 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:30.807343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:30.808378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:30.808911 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:31.050482 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:31.059754 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1ce7658c-5ab0-42ea-9de2-bb2cf435d404 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1509 microversion: 2.1 time: 0.268114 Jul 14 20:36:31.062672 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 103/215] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:30 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:31.531433 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3e17ef00-9ba8-41e7-80bc-f1f8720191e2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.132951 Jul 14 20:36:31.541056 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 113/216] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:36:30 2022] POST /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:36:31.681922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:31.682551 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:31.696279 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:31.696736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:31.697526 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:31.697967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:31.986717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:31.994819 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-66b85d9b-b607-4474-8a35-e2f23ebb0148 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.317560 Jul 14 20:36:31.995449 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 104/217] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:31 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:32.078636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:32.079244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:32.118416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:32.119196 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:32.121940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:32.122596 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:32.445830 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:32.461375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ae7e4d84-9413-4c54-9de7-aef2239783fb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1509 microversion: 2.1 time: 0.387603 Jul 14 20:36:32.466250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 114/218] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:32 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:32.480140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-f29340d3-aab7-4971-9098-e7eb5a6b6f78 req-3e387b68-06b6-4f5d-ae44-7a6debb34396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7e3618-7251-40af-8e26-c5d733bb282b", "tag": "24038675-ca8a-4d25-a426-7128133bafa7"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:32.499194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-f29340d3-aab7-4971-9098-e7eb5a6b6f78 req-3e387b68-06b6-4f5d-ae44-7a6debb34396 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:32.499740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-f29340d3-aab7-4971-9098-e7eb5a6b6f78 req-3e387b68-06b6-4f5d-ae44-7a6debb34396 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:32.535548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-f29340d3-aab7-4971-9098-e7eb5a6b6f78 req-3e387b68-06b6-4f5d-ae44-7a6debb34396 service nova] Creating event network-changed:24038675-ca8a-4d25-a426-7128133bafa7 for instance db7e3618-7251-40af-8e26-c5d733bb282b on hv-cinder-79987 Jul 14 20:36:32.553187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-f29340d3-aab7-4971-9098-e7eb5a6b6f78 req-3e387b68-06b6-4f5d-ae44-7a6debb34396 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074163 Jul 14 20:36:32.553886 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 105/219] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:36:33.016174 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:33.018524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:33.033168 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:33.034184 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:33.035361 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:33.036392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:33.244621 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:33.269784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=6 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:33.319557 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:33.330886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d8699992-1528-40cb-abe4-2b45ac95d163 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.323122 Jul 14 20:36:33.332508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 115/220] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:33 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:33.484952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:33.487303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:33.494676 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:33.497200 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:33.497657 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:33.498715 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:33.499201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:33.794159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:33.821233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2a7fa69f-bcc2-426f-8eb5-e4310f498f3d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1515 microversion: 2.1 time: 0.341058 Jul 14 20:36:33.821873 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 106/221] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:33 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1515 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:34.349755 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:34.350438 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:34.364907 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:34.365497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:34.366412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:34.366756 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:34.667953 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:34.679869 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8c25484f-8529-4f08-8c89-91b59ceed686 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.331724 Jul 14 20:36:34.681027 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 116/222] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:34 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:35.353095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6ca6a8b9-ba63-4d8e-9ffa-4b50cd3adeb2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'create', calling method: .version_select at 0x7fafb1b94ca0>, body: {"keypair": {"name": "tempest-keypair-2049057207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4Ghet6Xx0JcSgkfAvnQnM9K5fYkAebrpPSv2F37nwbo3e7+J8syR5BEOW3z1986muQzD3rOLILFXHolI3r5BNXGrC8+kYrb7ax2u7FKD/b36d2XJ45htLX6V1Zi7MPw=="}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:35.377270 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-6ca6a8b9-ba63-4d8e-9ffa-4b50cd3adeb2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for project cceb4db55bba4bd099104acdcb6d2762. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:36:35.383832 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-6ca6a8b9-ba63-4d8e-9ffa-4b50cd3adeb2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for user 765c911957bd4ca68dd520fc4fbba1c9 and project cceb4db55bba4bd099104acdcb6d2762. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:36:35.441591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6ca6a8b9-ba63-4d8e-9ffa-4b50cd3adeb2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093187 Jul 14 20:36:35.443241 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 107/223] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:36:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:36:35.699630 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:35.700747 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:35.717250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:35.722370 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:35.723449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:35.723991 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:36.233132 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:36.256830 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c023c0ee-9100-4283-ad84-f053530ef41d tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.560903 Jul 14 20:36:36.291250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 117/224] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:35 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:37.301975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:37.303398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:37.319745 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:37.322368 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:37.324588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:37.328891 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:37.815907 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:37.828546 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9f843f23-8115-4a6c-9575-c2b65f043c14 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.537725 Jul 14 20:36:37.829597 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 108/225] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:37 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:38.846581 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:38.848578 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:38.860543 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:38.863555 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:38.866472 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:38.868412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:38.869880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:39.247402 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:39.275650 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7806fd23-f1eb-442e-ae74-96f733aa2493 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.433673 Jul 14 20:36:39.276257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 118/226] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:38 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:39.541606 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b4d7ba2c-7d66-4678-aa61-c92670c0afbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:39.542160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b4d7ba2c-7d66-4678-aa61-c92670c0afbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:39.543720 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1031034977", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68cf6283-4fe3-4009-aca7-134fe5f10d19"}], "security_groups": [{"name": "tempest-securitygroup--478036983"}], "key_name": "tempest-keypair-2049057207", "user_data": "}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:39.548993 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4d7ba2c-7d66-4678-aa61-c92670c0afbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:39.553243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4d7ba2c-7d66-4678-aa61-c92670c0afbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:39.555363 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4d7ba2c-7d66-4678-aa61-c92670c0afbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:39.557388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4d7ba2c-7d66-4678-aa61-c92670c0afbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:39.631702 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b4d7ba2c-7d66-4678-aa61-c92670c0afbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/ips" status: 200 len: 151 microversion: 2.20 time: 0.094293 Jul 14 20:36:39.645758 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 109/227] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Jul 14 20:36:39 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:36:39.678098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0d634025-166f-4e2a-91f2-f76f97ca3d8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: .version_select at 0x7fafb1bdeaf0>, body: {"keypair": {"name": "tempest-keypair-662835395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyMyBl6/CTEkCEj5H4jefiAOh+dxsHQwiN5Lq6kVrbbCT4zLDpMwsBH8kCF2vZ7IYnSW6N9PSPFS8liG9auWI0eVuhZFw6cmF8GIikxLg6pyXq2aLmtNCwqYGVldSQBVg=="}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:39.710904 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-0d634025-166f-4e2a-91f2-f76f97ca3d8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:36:39.725313 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-0d634025-166f-4e2a-91f2-f76f97ca3d8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:36:39.753886 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0d634025-166f-4e2a-91f2-f76f97ca3d8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079785 Jul 14 20:36:39.754913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 110/228] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:36:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:36:39.765962 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] validate_networks() for [('68cf6283-4fe3-4009-aca7-134fe5f10d19', None, None, None, None, None)] {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:36:40.292546 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:40.293278 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:40.314471 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:40.314471 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:40.318719 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:40.319244 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:40.712934 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:40.724887 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2c535712-743b-43df-841a-1f376f6ae4c5 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.436446 Jul 14 20:36:40.745942 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 111/229] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:40 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:40.903019 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:36:40.904994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:36:40.905505 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:36:40.905939 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:36:40.906524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:36:40.935393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:40.936543 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:40.937697 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:40.938367 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:40.971585 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for project cceb4db55bba4bd099104acdcb6d2762. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:36:40.978224 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Getting quotas for user 765c911957bd4ca68dd520fc4fbba1c9 and project cceb4db55bba4bd099104acdcb6d2762. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:36:40.994058 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:36:40.997097 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:36:41.072893 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cff83360-197b-429d-8f8d-1ae993bcb3b4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.534958 Jul 14 20:36:41.080662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 119/230] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:36:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:36:41.092170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c05a38fc-e70a-4086-9a85-4163aeb0af95 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:41.096605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c05a38fc-e70a-4086-9a85-4163aeb0af95 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:41.110540 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:41.259366 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c05a38fc-e70a-4086-9a85-4163aeb0af95 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:41.267025 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c05a38fc-e70a-4086-9a85-4163aeb0af95 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1246 microversion: 2.1 time: 0.185421 Jul 14 20:36:41.267859 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 112/231] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:41 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1246 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:41.551336 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-12f85ae4-4003-4a42-b622-25524dc84381 req-0026f75c-8a5c-4ff2-9535-36c7f5ad1bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7e3618-7251-40af-8e26-c5d733bb282b", "name": "network-vif-plugged", "status": "completed", "tag": "24038675-ca8a-4d25-a426-7128133bafa7"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:41.593347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-12f85ae4-4003-4a42-b622-25524dc84381 req-0026f75c-8a5c-4ff2-9535-36c7f5ad1bca service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:41.595424 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-12f85ae4-4003-4a42-b622-25524dc84381 req-0026f75c-8a5c-4ff2-9535-36c7f5ad1bca service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:41.672234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-12f85ae4-4003-4a42-b622-25524dc84381 req-0026f75c-8a5c-4ff2-9535-36c7f5ad1bca service nova] Creating event network-vif-plugged:24038675-ca8a-4d25-a426-7128133bafa7 for instance db7e3618-7251-40af-8e26-c5d733bb282b on hv-cinder-79987 Jul 14 20:36:41.685066 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-12f85ae4-4003-4a42-b622-25524dc84381 req-0026f75c-8a5c-4ff2-9535-36c7f5ad1bca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140296 Jul 14 20:36:41.687711 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 113/232] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:36:41.760560 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:41.761321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:41.779898 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:41.780183 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:41.781398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:41.781887 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:42.118764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:42.131310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e62feabe-534f-4aec-a79d-8281713e1db9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.376820 Jul 14 20:36:42.134115 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 114/233] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:41 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:42.199648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a396c776-7836-41f5-ac71-d4dce24e6666 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Action: 'create', calling method: .version_select at 0x7fafb1b5a700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1335986240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrsdOrLrNUQ6xdYihR13Czbj+5vnKGsFG4eExCeDaoJFNpW3meqeYHz7cnqw/s2ZUa/ndLOCUTHKh/qaIrJLywmOWvrB4rPHcgnTeecLqB3BqQmFhLu1i/b4bA7m5UJJg=="}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:42.243134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-a396c776-7836-41f5-ac71-d4dce24e6666 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:36:42.253725 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-a396c776-7836-41f5-ac71-d4dce24e6666 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for user 6502e3ffa3b84333a00ea5f712767d61 and project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:36:42.289948 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:42.294063 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:42.299634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a396c776-7836-41f5-ac71-d4dce24e6666 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.761599 Jul 14 20:36:42.302256 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 120/234] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:36:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:36:42.311223 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:42.311738 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:42.312577 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:42.313025 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:42.464041 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:42.482789 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d1c6f5b6-0f6f-4ce8-9af7-81a6aa3a66c0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1298 microversion: 2.1 time: 0.197150 Jul 14 20:36:42.484000 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 115/235] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:42 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:42.707564 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:42.712636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:42.744956 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:42.747354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:42.753754 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:42.754218 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:42.768122 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-340552172", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "946dd351-5829-4dff-b5e5-6e232f299044"}], "security_groups": [{"name": "tempest-securitygroup--1298541773"}], "key_name": "tempest-keypair-662835395", "user_data": "}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:42.803960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lazy-loading 'flavor' on Instance uuid e306d8c2-449e-43db-8e98-53d049726ddc {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:36:42.993509 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] validate_networks() for [('946dd351-5829-4dff-b5e5-6e232f299044', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:36:43.222999 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-25c92637-ab85-43e7-b691-aca22b6acb13 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/action" status: 202 len: 0 microversion: 2.20 time: 0.541314 Jul 14 20:36:43.227179 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 121/236] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 14 20:36:42 2022] POST /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:36:43.232113 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:43.232815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:43.246090 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.246727 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.247730 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.248335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.480688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:43.493464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-07a8fb4f-0b67-4112-84cf-edc98d5978a6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.262409 Jul 14 20:36:43.493464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 122/237] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:43 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:43.505760 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:43.506370 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:43.520541 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.529672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.531465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.532398 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.736702 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:36:43.737326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:36:43.738099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:36:43.739071 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:36:43.739894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:36:43.752920 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.753547 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.754728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.755466 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.779357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:36:43.781423 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:43.787355 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:36:43.802031 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:36:43.805837 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:36:43.816503 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:43.824785 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:43.830235 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-44ea580c-dd4b-4064-92f0-9318a2c55112 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.335283 Jul 14 20:36:43.831314 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 123/238] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:43 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:43.847856 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:43.853294 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:43.869842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.871542 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.875783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:43.876745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:43.883501 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0ba535d7-ae4a-4737-b457-e42e081bb63e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.120398 Jul 14 20:36:43.884701 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 116/239] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:36:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 20:36:43.903340 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6eff35e3-026b-4e0e-9245-7826d131b7c9 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:43.905139 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6eff35e3-026b-4e0e-9245-7826d131b7c9 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:43.958474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:43.985034 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-835a8d73-d950-4d70-b7fd-344b67b855d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1306 microversion: 2.1 time: 0.148318 Jul 14 20:36:43.986357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 124/240] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:43 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1306 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:44.050748 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6eff35e3-026b-4e0e-9245-7826d131b7c9 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:44.067842 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6eff35e3-026b-4e0e-9245-7826d131b7c9 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1240 microversion: 2.1 time: 0.173599 Jul 14 20:36:44.080063 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 117/241] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:43 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1240 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:44.510208 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:44.511266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:44.524082 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:44.525154 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:44.532588 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:44.533889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:44.572343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:44.745594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:44.753658 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3f901e21-953d-45d3-8c02-8b806fa10453 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.249561 Jul 14 20:36:44.763297 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 125/242] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:44 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:44.852949 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:44.854175 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:44.861500 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:44.861943 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:44.862717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:44.863354 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:45.004551 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:45.005360 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:45.006352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:45.014352 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:45.014959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:45.016418 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:45.017241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:45.017812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:45.019702 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:45.020868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6f96bb94-7a5c-4c7a-9edf-dac07ae553af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.172463 Jul 14 20:36:45.035813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 118/243] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:44 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:36:45.085727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:45.086247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:45.092681 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:45.093217 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:45.093998 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:45.094463 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:45.136697 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:45.147491 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c357b079-6e88-4263-b9a9-d318a3fd7e07 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1306 microversion: 2.1 time: 0.147790 Jul 14 20:36:45.168576 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 126/244] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:44 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:45.182615 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:45.191959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-781b7aa2-7dfd-476e-b681-2cd69ca710fb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1244 microversion: 2.1 time: 0.109957 Jul 14 20:36:45.199566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 119/245] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:45 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:45.773856 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:45.774518 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:45.790754 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:45.795280 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:45.796312 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:45.798629 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:46.041382 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:46.042073 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:46.058041 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:46.060884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:46.063542 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:46.068650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:46.208525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:46.224047 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7b302011-9734-4486-95f6-e707cfa29db6 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1314 microversion: 2.1 time: 0.456381 Jul 14 20:36:46.227725 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 127/246] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:45 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:46.244919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:46.244919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:46.261526 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:46.261995 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:46.263441 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:46.265254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:46.650445 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:46.663802 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-033eabcc-13ee-441e-94d3-56830aea3912 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1306 microversion: 2.1 time: 0.426842 Jul 14 20:36:46.666462 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 128/247] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:46 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1306 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:46.671847 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:46.680774 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:46.690563 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:46.695895 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:46.696944 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:46.697549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:46.825291 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:46.841264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:46.846477 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:46.847930 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c0c9ae62-a0a5-4d9e-8739-0b0d1d3d0a8f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.810840 Jul 14 20:36:46.860625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 120/248] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:46 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:46.913927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:46.922627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-88e66807-5112-4ae6-91dd-dc5a1721159e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1236 microversion: 2.1 time: 0.254465 Jul 14 20:36:46.923872 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 129/249] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:46 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1236 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:47.245713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:47.247135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:47.254772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.255352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:47.256387 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.257043 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:47.501878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:47.509546 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-16a271da-63fc-4dff-a059-e07a56248dca tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1464 microversion: 2.1 time: 0.267774 Jul 14 20:36:47.510121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 121/250] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:47 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1464 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:47.552860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:47.553365 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:47.561268 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.569313 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:47.570179 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.570627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:47.625258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:36:47.683258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:47.683985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:47.693692 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.694362 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:47.695514 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.696307 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:47.775970 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b3be659c-01c7-47ce-bbba-b5eeda9d0a85 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 204 len: 0 microversion: 2.1 time: 0.225663 Jul 14 20:36:47.777016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 130/251] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:36:47 2022] DELETE /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:36:47.792618 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:47.794345 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:47.806313 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.808285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:47.810084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:47.810992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:48.060537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:48.069498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fce52d91-c30d-445c-a835-28d65221a2ef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1304 microversion: 2.1 time: 0.391546 Jul 14 20:36:48.070071 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 122/252] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:47 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1304 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:48.083106 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:48.083903 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:48.107972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:48.108434 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:48.109408 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:48.110010 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:48.115381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:48.289041 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:48.297775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3574186e-8597-4559-a524-871d55fe0181 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1470 microversion: 2.1 time: 0.512371 Jul 14 20:36:48.298393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 131/253] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:47 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:48.314428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:48.315656 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:48.325338 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:48.325897 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:48.327276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:48.329906 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:48.392121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:48.403221 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:48.405521 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:48.407440 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8c7ab439-cc69-4b90-b9a9-136d651e2c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.333846 Jul 14 20:36:48.420363 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 123/254] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:48 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:48.430598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:48.444648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-10fdfb61-2542-4bbd-b214-6b47b2e2090d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1292 microversion: 2.1 time: 0.144829 Jul 14 20:36:48.445257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 132/255] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:48 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1292 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:49.088698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:49.089428 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:49.097364 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.097932 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.098962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.099651 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.258067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:49.266819 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-95e56f69-4ffb-438f-80fe-277f2c1164dd tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.182448 Jul 14 20:36:49.267848 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 124/256] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:49 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:49.318808 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:49.319638 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:49.326713 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.327209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.327998 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.328441 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.428595 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:49.430818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:49.440295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.441563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.442798 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.443533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.520758 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:49.529991 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5c2e3341-06c8-4a49-afad-3b1d12b79361 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1470 microversion: 2.1 time: 0.215337 Jul 14 20:36:49.539918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 133/257] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:49 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:49.539918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:49.539918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:49.546252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.547910 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.549549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:49.550273 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:49.660467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:49.682778 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5132875b-ac8f-492b-9147-f60aaa80f61a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1292 microversion: 2.1 time: 0.151127 Jul 14 20:36:49.683442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 134/258] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:49 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1292 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:49.726469 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:49.745560 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:49.749480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:49.751416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-04a79da3-9d44-4ed7-9486-2f3789a399cb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.327821 Jul 14 20:36:49.752177 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 125/259] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:49 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:50.285550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:50.286781 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:50.297676 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:50.302139 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:50.303585 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:50.304274 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:50.548421 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:50.550176 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:50.557201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:50.557751 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:50.558631 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:50.559099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:50.872563 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:50.881874 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-fb666a3c-eb35-4135-9c08-772dddc3735f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.600824 Jul 14 20:36:50.885075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 135/260] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:50 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:50.889936 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:50.890759 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:50.898687 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:50.899308 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:50.900464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:50.901051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:50.971791 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:51.026744 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:51.036946 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a3d8a056-fe81-441d-8385-074df10cce81 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1470 microversion: 2.1 time: 0.492344 Jul 14 20:36:51.038216 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 126/261] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:50 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:51.043613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:51.044433 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:51.052960 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:51.053676 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:51.055037 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:51.055639 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:51.059157 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:51.071866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9591afdb-4004-4e50-8aaa-46042b2a7d15 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1298 microversion: 2.1 time: 0.183096 Jul 14 20:36:51.074505 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 136/262] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:50 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:51.312726 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-84fbbd42-3a83-4357-8799-976b6f09ca15 req-7cf36aca-3c32-4062-a1b3-e113541bf792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5c8801-ed84-48a2-b248-e655089e94c3", "tag": "f924a51a-1824-4be0-9b9b-700305bf906f"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:51.342412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-84fbbd42-3a83-4357-8799-976b6f09ca15 req-7cf36aca-3c32-4062-a1b3-e113541bf792 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:51.342882 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-84fbbd42-3a83-4357-8799-976b6f09ca15 req-7cf36aca-3c32-4062-a1b3-e113541bf792 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:51.356900 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-84fbbd42-3a83-4357-8799-976b6f09ca15 req-7cf36aca-3c32-4062-a1b3-e113541bf792 service nova] Creating event network-changed:f924a51a-1824-4be0-9b9b-700305bf906f for instance 6e5c8801-ed84-48a2-b248-e655089e94c3 on hv-cinder-79987 Jul 14 20:36:51.364478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-84fbbd42-3a83-4357-8799-976b6f09ca15 req-7cf36aca-3c32-4062-a1b3-e113541bf792 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055118 Jul 14 20:36:51.365973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 137/263] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:36:51.450557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:51.475299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:51.478348 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:51.481859 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-01d1d840-1388-47f1-ae0f-96facd658dbd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.440254 Jul 14 20:36:51.482923 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 127/264] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:51 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:51.901402 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:51.902313 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:51.917588 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:51.918485 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:51.919545 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:51.920177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:52.054225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:52.054914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:52.061773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:52.062514 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:52.063565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:52.064187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:52.067652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:52.075048 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f9155d67-73f8-449a-89f5-7ee16a8a285f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.179890 Jul 14 20:36:52.080612 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 138/265] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:51 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:52.093955 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:52.094789 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:52.102381 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:52.102985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:52.103873 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:52.104404 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:52.154656 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:52.163242 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8922978f-e0a0-40ad-9431-ee1baf97ef30 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1428 microversion: 2.1 time: 0.112675 Jul 14 20:36:52.173040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 128/266] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:52 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:52.260065 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:52.270096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b093d5a1-8e3c-4f16-9dcb-21ae8dfe59df tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.182489 Jul 14 20:36:52.270930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 139/267] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:52 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:52.501956 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:52.502623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:52.508774 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:52.509236 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:52.510021 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:52.510460 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:52.648344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:52.656708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:52.658214 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:52.659493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d657d0aa-0f8f-49ab-b789-190d3a212c7d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.161953 Jul 14 20:36:52.660059 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 129/268] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:52 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:53.098377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:53.099000 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:53.100931 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=10 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:53.106584 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.107063 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.107829 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.108265 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.180794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:53.181414 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:53.188055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.188535 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.189315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.189752 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.264449 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:53.268258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:53.272290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e6e873e5-953e-4647-bbbd-ec9439838076 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1428 microversion: 2.1 time: 0.095381 Jul 14 20:36:53.272859 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 130/269] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:53 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:53.276129 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a1ddea58-02ce-43f9-be62-775fb564e347 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.182216 Jul 14 20:36:53.276698 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 140/270] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:53 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:53.294732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:53.295369 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:53.301961 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.302407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.303196 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.303815 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.392895 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-881edbbe-49fc-497d-87a1-951c37acf937 req-68e23dd7-5c5c-4b7f-8ac3-3a89d0462c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7e3618-7251-40af-8e26-c5d733bb282b", "name": "network-vif-deleted", "tag": "24038675-ca8a-4d25-a426-7128133bafa7"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:53.401839 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-881edbbe-49fc-497d-87a1-951c37acf937 req-68e23dd7-5c5c-4b7f-8ac3-3a89d0462c64 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.402306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-881edbbe-49fc-497d-87a1-951c37acf937 req-68e23dd7-5c5c-4b7f-8ac3-3a89d0462c64 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.406816 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:53.416232 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-881edbbe-49fc-497d-87a1-951c37acf937 req-68e23dd7-5c5c-4b7f-8ac3-3a89d0462c64 service nova] Creating event network-vif-deleted:24038675-ca8a-4d25-a426-7128133bafa7 for instance db7e3618-7251-40af-8e26-c5d733bb282b on hv-cinder-79987 Jul 14 20:36:53.421914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-881edbbe-49fc-497d-87a1-951c37acf937 req-68e23dd7-5c5c-4b7f-8ac3-3a89d0462c64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033011 Jul 14 20:36:53.422513 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 141/271] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:36:53.439552 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:53.446995 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-46b3a113-8494-479b-bfe3-26e43e2c03b5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.156019 Jul 14 20:36:53.447564 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 131/272] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:53 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:53.680480 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:53.681260 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:53.698917 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.699764 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:53.700935 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:53.701387 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.009659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:54.018722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:54.020280 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:54.021738 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-71cdb403-5a4e-4b1b-8827-5bd16b031aad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.347697 Jul 14 20:36:54.022306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 142/273] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:53 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:54.295363 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:54.296602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:54.298785 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:54.301706 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:54.304091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:54.305750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=18 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:54.311334 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.311971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.312700 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.313386 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.314229 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.315222 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.315984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.316602 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.466239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.466239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.466239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lazy-loading 'fault' on Instance uuid db7e3618-7251-40af-8e26-c5d733bb282b {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:36:54.685698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80784a1d58a4b9186636b37d186a739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c1e417367fe41c9943a8b2297742120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:54.694345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-635277f4-51f7-4cfa-845e-ffc8ae18d926 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 200 len: 1304 microversion: 2.1 time: 0.406160 Jul 14 20:36:54.709970 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 132/274] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:54 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 1304 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:54.715763 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-04a2b4e2-d855-4d21-a52d-a943ef39cd18 req-54c40315-5aed-41e4-ae39-7be936031509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c76d46-a8ea-4bcd-91b5-d12a4bfd7522", "tag": "33415f35-0a2b-412a-b401-659c0b757bea"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:36:54.746467 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-04a2b4e2-d855-4d21-a52d-a943ef39cd18 req-54c40315-5aed-41e4-ae39-7be936031509 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.746966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-04a2b4e2-d855-4d21-a52d-a943ef39cd18 req-54c40315-5aed-41e4-ae39-7be936031509 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.766344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-04a2b4e2-d855-4d21-a52d-a943ef39cd18 req-54c40315-5aed-41e4-ae39-7be936031509 service nova] Creating event network-changed:33415f35-0a2b-412a-b401-659c0b757bea for instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 on hv-cinder-79987 Jul 14 20:36:54.773358 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-04a2b4e2-d855-4d21-a52d-a943ef39cd18 req-54c40315-5aed-41e4-ae39-7be936031509 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061386 Jul 14 20:36:54.774245 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 133/275] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:36:54.782739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:54.783474 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:54.794798 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.795788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.796981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:54.798539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:54.801278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:54.823538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-51ab08f9-c373-4fc2-a260-aafde16c3a72 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.528574 Jul 14 20:36:54.841715 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 143/276] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:54 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:55.045513 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:55.046259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:55.052743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:55.053203 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:55.053989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:55.054435 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:55.307790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:55.326368 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6846a63d-56e0-48fc-9245-d69b5864d494 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.550110 Jul 14 20:36:55.332781 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 134/277] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:54 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:55.470362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:55.483278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:55.484963 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:55.487014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3dfda32e-3851-475a-89f1-5909ad5d51ee tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.445412 Jul 14 20:36:55.494991 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 144/278] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:55 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:36:55.715888 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:55.716488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] [instance: db7e3618-7251-40af-8e26-c5d733bb282b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:55.723170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:55.723616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:55.724380 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:55.724814 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:55.737857 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] HTTP exception thrown: Instance db7e3618-7251-40af-8e26-c5d733bb282b could not be found. Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Request method failure captured: Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b HTTP/1.1 Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H5ER5vmZrbnooMvtq7Y0OKNEcdgWNxEXFMATimBJUSJULcS1xnl_99Vic9_HLzyYBF-6ww3K7aUuPHiFMwtvwmnl7UQkYXjjVu8Rxitz8Wpd6SdFfDZhy0lXosJNjX6lLzqy-vPKjCcozEW2p4jP4LD08Uy8ENrPZtQ9pKFPkbSZ3Q Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 3c1e417367fe41c9943a8b2297742120 Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesNegativeTest-1795131554 Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:36:55.739502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3c1e417367fe41c9943a8b2297742120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c1e417367fe41c9943a8b2297742120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c1e417367fe41c9943a8b2297742120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3c1e417367fe41c9943a8b2297742120", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesNegativeTest-1795131554 Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 3c1e417367fe41c9943a8b2297742120 Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesNegativeTest-1795131554 Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesNegativeTest-1795131554-project Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: c80784a1d58a4b9186636b37d186a739 Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesNegativeTest-1795131554-project Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance db7e3618-7251-40af-8e26-c5d733bb282b could not be found. Jul 14 20:36:55.741002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'db7e3618-7251-40af-8e26-c5d733bb282b'} Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7e3618-7251-40af-8e26-c5d733bb282b could not be found. Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:36:55.741896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7e3618-7251-40af-8e26-c5d733bb282b could not be found. Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7e3618-7251-40af-8e26-c5d733bb282b could not be found. Jul 14 20:36:55.743391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:36:55.744693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] Returning 404 to user: Instance db7e3618-7251-40af-8e26-c5d733bb282b could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:36:55.744693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c7cfe5b3-0659-4eea-a7ed-84d25a4ca7f9 tempest-VolumesNegativeTest-1795131554 tempest-VolumesNegativeTest-1795131554-project] 10.222.0.52 "GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b" status: 404 len: 111 microversion: 2.1 time: 0.028867 Jul 14 20:36:55.744693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 135/279] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:55 2022] GET /compute/v2.1/servers/db7e3618-7251-40af-8e26-c5d733bb282b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:36:55.840295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:55.841183 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:55.849031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:55.849578 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:55.851103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:55.851672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:56.027160 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:56.037040 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d8421d05-96e8-407a-9aeb-32b41dae8f39 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.200131 Jul 14 20:36:56.039075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 145/280] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:55 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:56.350001 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:56.350814 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:56.357429 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:56.357889 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:56.358664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:56.359160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:56.503142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:56.507652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:56.508252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:56.511927 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-07e8a38e-5cde-4ba7-b2b1-1139958b2ede tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.166085 Jul 14 20:36:56.512327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 136/281] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:56 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:36:56.524064 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:56.524565 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:56.525363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:56.525803 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:56.721964 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:56.730786 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:56.732648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:56.733856 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-612672e0-a758-49d9-be77-47b6016ae9c3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.230272 Jul 14 20:36:56.734428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 146/282] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:56 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:36:57.058777 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:57.060487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:57.070820 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:57.072563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:57.073580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:57.074121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:57.240499 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:57.249041 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6d30d377-85c1-4d2e-93a7-8eac9171c185 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.194874 Jul 14 20:36:57.249272 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 137/283] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:57 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:57.529825 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:57.531292 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:57.538238 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:57.538723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:57.539541 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:57.539981 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:57.756857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:57.759497 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:57.760602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:57.768114 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:57.768717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:57.769724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:57.770402 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:57.770525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-bbd3ba11-d2bb-473c-a6a2-90f754503cbf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.245194 Jul 14 20:36:57.771383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 147/284] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:57 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:57.964785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:57.978224 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:57.980409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:57.982218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1358db4a-347e-47dd-ba8c-185177130d9b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.233137 Jul 14 20:36:57.983155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 138/285] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:57 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:36:58.265576 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:58.266988 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:58.273878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:58.274435 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:58.275261 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:58.275738 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:58.480499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:58.506228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-516ea239-28e5-469d-99e2-9c75949704e9 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.244519 Jul 14 20:36:58.508917 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 148/286] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:58 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:58.787894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:58.788982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:58.795895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:58.796602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:58.798188 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:58.798633 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:58.979338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:58.990172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-126fc2bd-9369-49b8-84fa-7e323c9fcdd7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.206186 Jul 14 20:36:58.990747 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 139/287] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:58 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:36:59.005775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:59.006502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:59.013923 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:59.013923 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:59.017284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:59.017284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:59.185107 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:59.193442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:59.194961 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:59.196153 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d4ca3477-409f-44cc-b546-d416e9412702 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.194942 Jul 14 20:36:59.196707 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 149/288] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:36:58 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:36:59.526516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:36:59.527545 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:36:59.537202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:59.537737 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:59.538448 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:36:59.539374 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:36:59.716004 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:36:59.718707 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:36:59.726920 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1df50158-946c-4159-a4ac-8b34a394dabb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.204319 Jul 14 20:36:59.736442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 140/289] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:36:59 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:00.009333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:00.010898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:00.020570 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:00.021659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:00.022745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:00.023592 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:00.216348 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:00.217252 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:00.230076 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:00.231177 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:00.232450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:00.235068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:00.323800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:00.336222 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5a406442-8e8f-4f7a-9478-c7f8352affa0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.331626 Jul 14 20:37:00.337177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 150/290] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:00 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:00.483566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:00.504053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:00.507807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:00.509265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-06060601-0e0b-4737-9203-b0ec68432668 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.297406 Jul 14 20:37:00.510196 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 141/291] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:00 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:00.746300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:00.747598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:00.759293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:00.759894 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:00.760837 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:00.761334 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:00.976512 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:00.984704 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-22aa9f85-a813-4cac-8996-aabec0cca9d8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.243167 Jul 14 20:37:00.995878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 151/292] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:00 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:01.354283 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:01.355090 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:01.363235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:01.363791 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:01.364813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:01.365399 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:01.530307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:01.530926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:01.534603 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:01.539880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:01.540569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:01.541340 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:01.541944 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:01.543717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:01.561691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8a8856b5-4bc7-4766-b7fe-23765183cafd tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.211444 Jul 14 20:37:01.562468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 142/293] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:01 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:01.716759 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:01.725897 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:01.727489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:01.728652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-593880d8-7838-4053-b642-a30a41a99912 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.202657 Jul 14 20:37:01.729214 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 152/294] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:01 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:02.002179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:02.002878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:02.009357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:02.009824 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:02.010602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:02.011068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:02.156689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:02.164168 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d5280e81-8818-484a-a8e7-11f4f9499b9b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.166339 Jul 14 20:37:02.164732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 143/295] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:01 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:02.579558 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:02.580310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:02.586798 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:02.587289 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:02.588337 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:02.588721 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:02.748446 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:02.749259 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:02.757359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:02.758118 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:02.758973 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:02.759614 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:02.813441 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:02.824323 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-908ff348-89e5-4c8f-b197-1efb35585029 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.247505 Jul 14 20:37:02.824932 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 153/296] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:02 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:02.840410 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-e0a11ca3-4e66-4e21-93ab-fa586140c63c req-9dd08d12-7774-4086-9f66-2cf9a1127380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5c8801-ed84-48a2-b248-e655089e94c3", "name": "network-vif-plugged", "status": "completed", "tag": "f924a51a-1824-4be0-9b9b-700305bf906f"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:02.850362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-e0a11ca3-4e66-4e21-93ab-fa586140c63c req-9dd08d12-7774-4086-9f66-2cf9a1127380 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:02.851121 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-e0a11ca3-4e66-4e21-93ab-fa586140c63c req-9dd08d12-7774-4086-9f66-2cf9a1127380 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:02.863781 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-e0a11ca3-4e66-4e21-93ab-fa586140c63c req-9dd08d12-7774-4086-9f66-2cf9a1127380 service nova] Creating event network-vif-plugged:f924a51a-1824-4be0-9b9b-700305bf906f for instance 6e5c8801-ed84-48a2-b248-e655089e94c3 on hv-cinder-79987 Jul 14 20:37:02.871282 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-e0a11ca3-4e66-4e21-93ab-fa586140c63c req-9dd08d12-7774-4086-9f66-2cf9a1127380 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033913 Jul 14 20:37:02.872475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 154/297] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:02.941121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:02.954385 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:02.957903 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:02.959942 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4001970e-505f-4cd8-9869-22d05dc2875a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1745 microversion: 2.20 time: 0.216446 Jul 14 20:37:02.960722 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 144/298] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:02 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1745 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:03.184331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:03.185265 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:03.194212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:03.195263 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:03.196525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:03.197128 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:03.350566 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:03.359174 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2a510e54-901d-4e9f-9439-96a69d79973c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.181312 Jul 14 20:37:03.359771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 155/299] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:03 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:03.841709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:03.842341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:03.850372 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:03.850807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:03.851615 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:03.852040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:03.996156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:03.997429 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:04.004952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:04.005417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:04.006222 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:04.006862 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:04.014159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:04.031033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7c0ec0ea-9cd4-4594-8bfd-e35eebf524e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.192657 Jul 14 20:37:04.033011 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 145/300] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:03 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:04.191377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:04.200009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:04.201643 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:04.202926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-936974d3-5247-4c32-a970-0311fa0645fd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1745 microversion: 2.20 time: 0.212009 Jul 14 20:37:04.203525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 156/301] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:03 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:04.377004 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:04.377681 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:04.384611 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:04.384611 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:04.385409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:04.385904 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:04.589387 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:04.598227 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e7ade95c-b761-4810-a557-60a62156f2a1 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1371 microversion: 2.1 time: 0.225056 Jul 14 20:37:04.598813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 146/302] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:04 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:04.914210 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-f5495fc9-d2b1-449d-a559-0bf039dab214 req-2d0219b7-7c83-4f05-9081-70d64b666d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c76d46-a8ea-4bcd-91b5-d12a4bfd7522", "name": "network-vif-plugged", "status": "completed", "tag": "33415f35-0a2b-412a-b401-659c0b757bea"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:04.923501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-f5495fc9-d2b1-449d-a559-0bf039dab214 req-2d0219b7-7c83-4f05-9081-70d64b666d3a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:04.923946 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-f5495fc9-d2b1-449d-a559-0bf039dab214 req-2d0219b7-7c83-4f05-9081-70d64b666d3a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:04.936678 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-f5495fc9-d2b1-449d-a559-0bf039dab214 req-2d0219b7-7c83-4f05-9081-70d64b666d3a service nova] Creating event network-vif-plugged:33415f35-0a2b-412a-b401-659c0b757bea for instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 on hv-cinder-79987 Jul 14 20:37:04.941934 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-f5495fc9-d2b1-449d-a559-0bf039dab214 req-2d0219b7-7c83-4f05-9081-70d64b666d3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Jul 14 20:37:04.942548 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 157/303] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:37:05.049462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:05.050087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:05.058435 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.058880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.059714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.060157 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.230486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:05.236820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:05.251569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.252306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.252537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:05.253675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.254594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.264023 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-249c7f98-f73f-49ea-9df3-cca4801158af tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.218346 Jul 14 20:37:05.265052 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 147/304] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:05 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:05.466123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:05.475540 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:05.477537 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:05.478729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e579eccc-a703-43f9-be19-0e7a0c34ef25 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1745 microversion: 2.20 time: 0.259576 Jul 14 20:37:05.479478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 158/305] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:05 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:05.616237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:05.616846 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:05.623499 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.624094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.625269 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.626297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.764232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:05.772570 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-be9e76d7-a9d6-419f-aaf8-8cd35785aada tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1564 microversion: 2.1 time: 0.160399 Jul 14 20:37:05.773151 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 148/306] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:05 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:05.789419 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-23667301-d3f9-48d7-a234-9d0bee6466c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:05.789904 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-23667301-d3f9-48d7-a234-9d0bee6466c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:05.796134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-23667301-d3f9-48d7-a234-9d0bee6466c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.796580 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-23667301-d3f9-48d7-a234-9d0bee6466c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.797424 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-23667301-d3f9-48d7-a234-9d0bee6466c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:05.798377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-23667301-d3f9-48d7-a234-9d0bee6466c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:05.877410 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-23667301-d3f9-48d7-a234-9d0bee6466c7 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091913 Jul 14 20:37:05.878011 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 159/307] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:37:05 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:06.292955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:06.294191 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:06.301109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:06.301516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:06.302258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:06.302696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:06.460587 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:06.470164 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e815293a-69fc-4eb6-bf1e-1c2e08fa4817 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1366 microversion: 2.1 time: 0.180400 Jul 14 20:37:06.471409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 149/308] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:06 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:06.498075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:06.498829 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:06.510729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:06.512850 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:06.513927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:06.514866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:06.523624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:06.574254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-837577739", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "networks": [{"uuid": "74d902ae-4216-4f44-80f4-fe09909794ea"}]}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:06.643943 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] validate_networks() for [('74d902ae-4216-4f44-80f4-fe09909794ea', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:37:06.669680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:06.679253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:06.680791 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:06.682249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0dbe4c89-25b8-48d1-9d26-e4ded1581d91 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1745 microversion: 2.20 time: 0.188562 Jul 14 20:37:06.683046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 160/309] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:06 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:07.023455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:37:07.023894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:37:07.024513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:37:07.025117 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:37:07.025598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:37:07.030584 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:07.046537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.048793 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.049732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.050244 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.073013 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Getting quotas for project 806c059a19044c6ebcd8f2cc50d9591d. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:37:07.077936 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Getting quotas for user 1c8fa181da604f8cb41837dd570f9510 and project 806c059a19044c6ebcd8f2cc50d9591d. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:37:07.091446 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:37:07.093708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:37:07.111885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-0539c535-ba03-451a-a1cc-94ca9c40ebc4 req-97c06f23-0a77-4164-8ba0-152fe12909c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5c8801-ed84-48a2-b248-e655089e94c3", "tag": "f924a51a-1824-4be0-9b9b-700305bf906f"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:07.121773 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-0539c535-ba03-451a-a1cc-94ca9c40ebc4 req-97c06f23-0a77-4164-8ba0-152fe12909c1 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.123100 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-0539c535-ba03-451a-a1cc-94ca9c40ebc4 req-97c06f23-0a77-4164-8ba0-152fe12909c1 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.136341 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-0539c535-ba03-451a-a1cc-94ca9c40ebc4 req-97c06f23-0a77-4164-8ba0-152fe12909c1 service nova] Creating event network-changed:f924a51a-1824-4be0-9b9b-700305bf906f for instance 6e5c8801-ed84-48a2-b248-e655089e94c3 on hv-cinder-79987 Jul 14 20:37:07.141463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-0539c535-ba03-451a-a1cc-94ca9c40ebc4 req-97c06f23-0a77-4164-8ba0-152fe12909c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033919 Jul 14 20:37:07.142704 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 161/310] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:37:07.146480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-01dfd5da-11d3-45a4-927a-489c296d9834 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575912 Jul 14 20:37:07.147146 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 150/311] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 20:37:07.165837 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ce0f4eb8-7d30-451f-a002-939878fecfc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:07.166893 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ce0f4eb8-7d30-451f-a002-939878fecfc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:07.231538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ce0f4eb8-7d30-451f-a002-939878fecfc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:07.240174 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ce0f4eb8-7d30-451f-a002-939878fecfc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1213 microversion: 2.1 time: 0.078498 Jul 14 20:37:07.241277 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 162/312] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:07 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:07.488947 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:07.489625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:07.496849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.497512 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.498299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.498919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.655691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:07.664410 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c19f6d06-7d95-4bb4-b813-c4abc4eecaca tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1555 microversion: 2.1 time: 0.180693 Jul 14 20:37:07.664996 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 151/313] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:07 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:07.681027 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f1988b75-0a9c-4c24-8bbd-963c505c2c1d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:07.681566 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f1988b75-0a9c-4c24-8bbd-963c505c2c1d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:07.688826 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1988b75-0a9c-4c24-8bbd-963c505c2c1d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.689316 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1988b75-0a9c-4c24-8bbd-963c505c2c1d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.690089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1988b75-0a9c-4c24-8bbd-963c505c2c1d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.690525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1988b75-0a9c-4c24-8bbd-963c505c2c1d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.701321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:07.702180 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:07.708966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.709533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.710561 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:07.711144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:07.820792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f1988b75-0a9c-4c24-8bbd-963c505c2c1d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142513 Jul 14 20:37:07.822791 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 163/314] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:37:07 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:08.050922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:08.067727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:08.069739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:08.070967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b06dcb80-1e12-407b-a887-b267bae2348e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.373667 Jul 14 20:37:08.083667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 152/315] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:07 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:08.257992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:08.258835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:08.282140 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:08.283027 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:08.284459 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:08.285112 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:08.476221 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-23df74a6-3368-42b4-8361-95203f0f3359 req-281ee18d-9cfa-42ff-96f3-444392cd77e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e306d8c2-449e-43db-8e98-53d049726ddc", "name": "network-vif-plugged", "status": "completed", "tag": "1ac0a834-cdf8-45d5-b1de-b010bb6c8485"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:08.492676 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-23df74a6-3368-42b4-8361-95203f0f3359 req-281ee18d-9cfa-42ff-96f3-444392cd77e2 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:08.496747 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-23df74a6-3368-42b4-8361-95203f0f3359 req-281ee18d-9cfa-42ff-96f3-444392cd77e2 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:08.515389 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:08.525139 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-23df74a6-3368-42b4-8361-95203f0f3359 req-281ee18d-9cfa-42ff-96f3-444392cd77e2 service nova] Creating event network-vif-plugged:1ac0a834-cdf8-45d5-b1de-b010bb6c8485 for instance e306d8c2-449e-43db-8e98-53d049726ddc on hv-cinder-79987 Jul 14 20:37:08.538042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6917cb0e-b47b-495d-bb20-31530be33a85 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1265 microversion: 2.1 time: 0.281898 Jul 14 20:37:08.542046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 164/316] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:08 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:08.556983 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-23df74a6-3368-42b4-8361-95203f0f3359 req-281ee18d-9cfa-42ff-96f3-444392cd77e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085001 Jul 14 20:37:08.564382 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 153/317] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:37:08.738368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1679453321", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1335986240", "security_groups": [{"name": "tempest-secgroup-smoke-2107497457"}], "block_device_mapping_v2": [{"uuid": "089928b1-849a-4c7f-a05a-a973d701a06f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c361a5af-edf6-43ec-86b8-8164b7612499"}]}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:09.090398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:09.091127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:09.104051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:09.105982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:09.107584 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:09.108201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:09.377089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] validate_networks() for [('c361a5af-edf6-43ec-86b8-8164b7612499', None, None, None, None, None)] {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:37:09.784365 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:09.805582 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:09.808354 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:09.816006 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-97526861-9284-46c9-9cd0-790379339385 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.729901 Jul 14 20:37:09.821983 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 154/318] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:09 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:09.827051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:09.830730 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:09.838537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:09.839362 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:09.840633 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:09.841806 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:09.978601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:09.988698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d36170ab-0cfa-4028-945c-d846fb834c48 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1271 microversion: 2.1 time: 0.165329 Jul 14 20:37:09.992849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 155/319] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:09 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:10.506752 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:37:10.507497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:37:10.508226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:37:10.509030 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:37:10.509881 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:37:10.523129 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:10.524029 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:10.525137 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:10.526144 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:10.551516 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:37:10.556958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for user 6502e3ffa3b84333a00ea5f712767d61 and project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:37:10.648491 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:37:10.650678 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='089928b1-849a-4c7f-a05a-a973d701a06f',volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:37:10.783957 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-30a9d5d4-4941-4ee2-9c29-fc447390d1b1 req-1d7ebfbe-f614-4c8f-aca3-d198b9d9bd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c76d46-a8ea-4bcd-91b5-d12a4bfd7522", "tag": "33415f35-0a2b-412a-b401-659c0b757bea"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:10.802053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-30a9d5d4-4941-4ee2-9c29-fc447390d1b1 req-1d7ebfbe-f614-4c8f-aca3-d198b9d9bd6c service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:10.803312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-30a9d5d4-4941-4ee2-9c29-fc447390d1b1 req-1d7ebfbe-f614-4c8f-aca3-d198b9d9bd6c service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:10.827984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-30a9d5d4-4941-4ee2-9c29-fc447390d1b1 req-1d7ebfbe-f614-4c8f-aca3-d198b9d9bd6c service nova] Creating event network-changed:33415f35-0a2b-412a-b401-659c0b757bea for instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 on hv-cinder-79987 Jul 14 20:37:10.839662 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-30a9d5d4-4941-4ee2-9c29-fc447390d1b1 req-1d7ebfbe-f614-4c8f-aca3-d198b9d9bd6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061107 Jul 14 20:37:10.843894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 156/320] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:10.852793 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:10.857273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:10.875429 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:10.876378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:10.877395 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:10.886478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a56ee7cd-d581-4bd5-86c8-ebdcac9380fd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.150005 Jul 14 20:37:10.889903 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:10.894591 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 165/321] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:37:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:37:10.903731 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-60ed0e38-9bb4-4dd3-8c76-25e96341c4d1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:10.926193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-60ed0e38-9bb4-4dd3-8c76-25e96341c4d1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:11.258314 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-60ed0e38-9bb4-4dd3-8c76-25e96341c4d1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:11.271768 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-60ed0e38-9bb4-4dd3-8c76-25e96341c4d1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1095 microversion: 2.1 time: 0.375371 Jul 14 20:37:11.275043 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 166/322] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:10 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1095 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:11.318577 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:11.319267 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:11.342060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:11.342729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:11.345154 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:11.345828 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:11.469623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:11.491243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:11.495071 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:11.499300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-396eb75d-7311-419d-a5c5-104410a2b1fc tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.653283 Jul 14 20:37:11.503814 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 157/323] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:10 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:11.825799 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:11.847874 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-90dda17a-7421-41a3-8192-e609bd2d587d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.567763 Jul 14 20:37:11.851332 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 167/324] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:11 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:12.292740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:12.294147 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:12.303619 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:12.304480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:12.305771 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:12.306713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:12.459182 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:12.482144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-50a51190-78ce-4d7f-ad1e-cc0dfc704bf9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1137 microversion: 2.1 time: 0.192990 Jul 14 20:37:12.500125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 158/325] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:12 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1137 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:12.540011 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:12.540583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:12.557734 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:12.558582 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:12.568966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:12.569980 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:12.866085 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:12.867369 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:12.878312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:12.881105 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:12.882047 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:12.882504 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:12.931972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:12.987989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:12.996472 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:13.006246 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:13.007816 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4c757383-499c-4c03-890c-2692e34e01af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.472974 Jul 14 20:37:13.008864 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 168/326] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:12 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:13.026856 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-7dfb5a04-2a94-490a-a320-85a55dd1f7fa req-275c4bb0-e372-4b82-ba0b-2eba91ff0803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce9f3a8-8bf1-45b7-b55c-e523c2a8169c", "tag": "5c3557db-3eb0-46b0-9b54-a465dc81f9b2"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:13.049440 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-7dfb5a04-2a94-490a-a320-85a55dd1f7fa req-275c4bb0-e372-4b82-ba0b-2eba91ff0803 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:13.049872 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-7dfb5a04-2a94-490a-a320-85a55dd1f7fa req-275c4bb0-e372-4b82-ba0b-2eba91ff0803 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:13.074682 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-7dfb5a04-2a94-490a-a320-85a55dd1f7fa req-275c4bb0-e372-4b82-ba0b-2eba91ff0803 service nova] Creating event network-changed:5c3557db-3eb0-46b0-9b54-a465dc81f9b2 for instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c on hv-cinder-79987 Jul 14 20:37:13.085177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-7dfb5a04-2a94-490a-a320-85a55dd1f7fa req-275c4bb0-e372-4b82-ba0b-2eba91ff0803 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074822 Jul 14 20:37:13.086788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 169/327] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:13.280379 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:13.294232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-796c2c71-293b-44b6-a33e-29b6511d0495 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.432127 Jul 14 20:37:13.317955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 159/328] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:12 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:13.510125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:13.511171 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:13.523325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:13.529690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:13.531046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:13.532288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:13.644549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:13.661194 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5fc81662-202d-4919-9942-813d3a1178ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1211 microversion: 2.1 time: 0.153404 Jul 14 20:37:13.664974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 170/329] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:13 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:14.028483 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:14.029599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:14.048182 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:14.051453 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:14.059979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:14.060867 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:14.316705 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:14.320383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:14.320582 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:14.336891 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:14.339370 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:14.340852 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a1dd1c48-3b59-4795-803a-b5abc04a9331 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.317237 Jul 14 20:37:14.341761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 160/330] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:14 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:14.356326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:14.357157 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:14.358202 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:14.358644 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:14.564432 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:14.574833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cbd9b496-b96e-4dc4-8d92-9ab7d6dd37f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.266363 Jul 14 20:37:14.576060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 171/331] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:14 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:14.684207 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:14.685477 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:14.695201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:14.695648 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:14.696427 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:14.696874 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:14.879649 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:14.893498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d1101a2e-c765-44a7-aea1-8092ad09f390 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1279 microversion: 2.1 time: 0.216259 Jul 14 20:37:14.894095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 161/332] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:14 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1279 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:15.360574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:15.361816 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:15.373784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:15.374756 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:15.376769 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:15.377572 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:15.594316 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:15.595640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:15.603808 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:15.604536 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:15.605660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:15.606389 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:15.689628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:15.704217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:15.716173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:15.717973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-53249e49-4a9f-48c9-a200-b3780ddd07b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.362108 Jul 14 20:37:15.719057 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 172/333] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:15 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:15.911449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:15.912111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:15.919987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:15.920449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:15.921261 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:15.929273 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:15.981115 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:16.005316 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e1b4a11e-e569-4f9b-bf17-6926276f5311 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.416260 Jul 14 20:37:16.005916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 162/334] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:15 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:16.241956 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-b4d8ce95-0e0e-4977-9774-fdb3e40a5acc req-a1576591-7399-4d16-89e1-c06c32634606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f144a8-c1b4-424d-80f0-da744bd56947", "tag": "6a85c30d-87e7-49c7-9ba4-5135c2402791"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:16.277118 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-b4d8ce95-0e0e-4977-9774-fdb3e40a5acc req-a1576591-7399-4d16-89e1-c06c32634606 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:16.277566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-b4d8ce95-0e0e-4977-9774-fdb3e40a5acc req-a1576591-7399-4d16-89e1-c06c32634606 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:16.292906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-b4d8ce95-0e0e-4977-9774-fdb3e40a5acc req-a1576591-7399-4d16-89e1-c06c32634606 service nova] Creating event network-changed:6a85c30d-87e7-49c7-9ba4-5135c2402791 for instance b3f144a8-c1b4-424d-80f0-da744bd56947 on hv-cinder-79987 Jul 14 20:37:16.300311 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-b4d8ce95-0e0e-4977-9774-fdb3e40a5acc req-a1576591-7399-4d16-89e1-c06c32634606 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075244 Jul 14 20:37:16.300914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 163/335] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:37:16.451657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:16.502664 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b69ff38d-f41e-46ea-be38-fff455f2770e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.596179 Jul 14 20:37:16.508922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 173/336] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:15 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:16.739936 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:16.741577 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:16.749748 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:16.751859 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:16.753885 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:16.754740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:16.945010 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:16.960085 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:16.973012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:16.974660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7d891a6c-33a0-4abd-9d51-c40d02fb1d57 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.240678 Jul 14 20:37:16.991325 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 164/337] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:16 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:17.029460 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:17.030524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:17.043736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:17.044323 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:17.045211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:17.045749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:17.232278 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:17.248780 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4cb0dbec-5771-4f1f-9ab2-f033c7ff911b tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.222986 Jul 14 20:37:17.249716 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 174/338] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:17 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:17.527834 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:17.529480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:17.533106 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:17.534519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=6 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:17.545273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:17.546611 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:17.547898 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:17.548360 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:17.761692 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:17.777787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-75e72564-a9d0-460e-b8db-fc7f0bdd6f0c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.256654 Jul 14 20:37:17.791702 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 165/339] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:17 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:17.994497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:17.995239 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:18.002758 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:18.003627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:18.004661 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:18.005349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:18.214259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:18.224675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:18.226722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:18.228180 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cad5f200-13b0-4612-b6fd-b9ada3be27b3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.237727 Jul 14 20:37:18.229319 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 175/340] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:17 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:18.271999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:18.273521 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:18.289387 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:18.289840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:18.290635 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:18.291139 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:18.544733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:18.559854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-df2837aa-0b6b-4558-91ed-f2d03680b7f0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.289005 Jul 14 20:37:18.560980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 166/341] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:18 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:18.801771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:18.802667 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:18.809490 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:18.809944 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:18.810946 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:18.812123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:19.013859 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:19.029599 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f630f4f6-410c-40ce-90af-65a4c3299c5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.235582 Jul 14 20:37:19.030714 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 176/342] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:18 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:19.257133 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:19.258488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:19.266784 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:19.267275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:19.268095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:19.268640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:19.436933 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:19.446415 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:19.448000 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:19.449195 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4c0af441-b843-42da-b881-d742e9576ddf tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.196412 Jul 14 20:37:19.449766 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 167/343] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:19 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:19.584966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:19.584966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:19.591849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:19.592491 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:19.593384 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:19.593934 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:19.786818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:19.797720 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9eb6b24a-c5af-4bdb-98c5-4b1d6e68a0f8 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.217289 Jul 14 20:37:19.799231 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 177/344] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:19 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:20.050438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:20.051652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:20.060508 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:20.061033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:20.062142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:20.062634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:20.260237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:20.269775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-55d405e0-186e-4357-afe5-b8a2f971d2fe tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.225730 Jul 14 20:37:20.270377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 168/345] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:20 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:20.379640 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-32ed1827-3cd0-451c-a39a-888d70243561 req-4f5b1a92-9411-4c21-8c3a-274f77a58822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce9f3a8-8bf1-45b7-b55c-e523c2a8169c", "name": "network-vif-plugged", "status": "completed", "tag": "5c3557db-3eb0-46b0-9b54-a465dc81f9b2"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:20.398549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-32ed1827-3cd0-451c-a39a-888d70243561 req-4f5b1a92-9411-4c21-8c3a-274f77a58822 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:20.400614 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-32ed1827-3cd0-451c-a39a-888d70243561 req-4f5b1a92-9411-4c21-8c3a-274f77a58822 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:20.419757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-32ed1827-3cd0-451c-a39a-888d70243561 req-4f5b1a92-9411-4c21-8c3a-274f77a58822 service nova] Creating event network-vif-plugged:5c3557db-3eb0-46b0-9b54-a465dc81f9b2 for instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c on hv-cinder-79987 Jul 14 20:37:20.428857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-32ed1827-3cd0-451c-a39a-888d70243561 req-4f5b1a92-9411-4c21-8c3a-274f77a58822 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057130 Jul 14 20:37:20.429692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 178/346] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:20.471515 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:20.472371 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:20.481029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:20.481672 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:20.482851 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:20.483415 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:20.641650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:20.650677 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:20.652250 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:20.653435 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b05e95e4-0e60-44e4-b3d9-cecf963cd4fb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1740 microversion: 2.20 time: 0.187585 Jul 14 20:37:20.654006 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 169/347] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:20 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:20.814186 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:20.820965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:20.821853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:20.829514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:20.829973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:20.830766 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:20.831240 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:20.982507 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:20.990296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-de9016bb-b866-4387-9fec-7e0c6d1f2a35 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.178278 Jul 14 20:37:20.990892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 179/348] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:20 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:21.286908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:21.287520 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:21.294188 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:21.294634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:21.295438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:21.295874 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:21.437071 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:21.445501 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-bbecc2b4-5183-4763-9dd0-e84a2a8915be tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.162386 Jul 14 20:37:21.446071 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 170/349] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:21 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:21.681107 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:21.681911 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:21.684094 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=10 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:21.692854 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:21.693309 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:21.694100 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:21.694541 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:21.839769 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:21.852750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:21.854258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:21.855486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b6820e3a-d4f4-4a20-a48e-3781248c4d08 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1722 microversion: 2.20 time: 0.178450 Jul 14 20:37:21.856052 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 180/350] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:21 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:22.007500 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:22.008147 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:22.014511 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:22.014991 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:22.016296 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:22.016736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:22.155418 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:22.164220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7aa4dc5f-9fa2-436a-a49e-454a3ddd9abb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.160491 Jul 14 20:37:22.164805 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 171/351] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:22 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:22.464015 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:22.464657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:22.471012 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:22.471462 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:22.472246 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:22.472680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:22.646368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:22.649968 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:22.655542 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ddf3bae7-a557-4dc8-836c-ee5298b0a8a1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.195574 Jul 14 20:37:22.656124 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 181/352] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:22 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:22.875536 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:22.876267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:22.883393 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:22.883850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:22.884653 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:22.885131 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:23.036512 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:23.045770 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:23.047987 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:23.049225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0b515cff-5a6a-47b6-94f5-2bf5a90727f8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1722 microversion: 2.20 time: 0.178263 Jul 14 20:37:23.049798 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 172/353] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:22 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:23.182663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:23.183730 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:23.191415 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:23.191863 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:23.192675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:23.193110 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:23.391845 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:23.400068 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9c41a0e6-349d-4f3e-8d4f-05aa8bd03f26 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1313 microversion: 2.1 time: 0.223087 Jul 14 20:37:23.400652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 182/354] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:23 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:23.672661 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:23.673285 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:23.679979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:23.680441 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:23.681233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:23.681680 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:23.831179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:23.839213 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6d4bc45b-329d-460f-a423-cf3b385fcbc7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.170261 Jul 14 20:37:23.839713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 173/355] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:23 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:24.073029 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:24.073633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:24.079987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:24.080421 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:24.081204 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:24.081635 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:24.224743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:24.233146 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:24.235006 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:24.236213 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a42e5eb5-e3d1-4a8f-afbe-b5ab2f1fa679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1722 microversion: 2.20 time: 0.167218 Jul 14 20:37:24.236790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 183/356] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:24 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:24.417878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:24.418435 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:24.425113 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:24.425570 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:24.426350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:24.426794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:24.567135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:24.579663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4ca1f49a-c094-46e0-901f-cf51ccec1052 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1496 microversion: 2.1 time: 0.165133 Jul 14 20:37:24.580688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 174/357] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:24 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1496 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:24.856488 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:24.857108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:24.864059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:24.864854 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:24.865662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:24.866111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:25.016109 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:25.024581 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-871f8153-f74b-4262-8009-5543b7a53aaf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.171839 Jul 14 20:37:25.025184 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 184/358] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:24 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:25.189775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:25.190276 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:25.196586 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:25.197037 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:25.197830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:25.198262 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:25.229462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:37:25.255507 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:25.256428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:25.263355 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:25.264199 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:25.264997 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:25.266056 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:25.273398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:25.337428 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-41d72ec6-bf45-4b0f-96c2-3dc3880448b1 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 204 len: 0 microversion: 2.1 time: 0.151185 Jul 14 20:37:25.338052 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 175/359] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:37:25 2022] DELETE /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 20:37:25.347171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:25.347707 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:25.354356 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:25.355073 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:25.355906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:25.356345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:25.448098 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:25.456772 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:25.458299 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:25.459525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e39286b2-62ac-4947-8872-6891cd5d7a2c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1722 microversion: 2.20 time: 0.207931 Jul 14 20:37:25.460444 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 185/360] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:25 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:25.518975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:25.527257 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a704929e-f849-4479-b28c-fbe29967e2ec tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1502 microversion: 2.1 time: 0.184350 Jul 14 20:37:25.527849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 176/361] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:25 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:26.042510 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:26.043161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:26.049522 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:26.049970 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:26.050744 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:26.051211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:26.214588 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:26.223494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-17ded6d2-84b3-4b04-b7f8-a5dd2f369653 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.184929 Jul 14 20:37:26.224198 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 186/362] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:26 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:26.254008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-4055ea72-7f09-4e15-bfca-056585af5d1d req-3a670833-b96f-48a1-a1b8-ec504983642a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e306d8c2-449e-43db-8e98-53d049726ddc", "name": "network-vif-unplugged", "status": "completed", "tag": "1ac0a834-cdf8-45d5-b1de-b010bb6c8485"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:26.263330 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-4055ea72-7f09-4e15-bfca-056585af5d1d req-3a670833-b96f-48a1-a1b8-ec504983642a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:26.263846 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-4055ea72-7f09-4e15-bfca-056585af5d1d req-3a670833-b96f-48a1-a1b8-ec504983642a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:26.278272 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-4055ea72-7f09-4e15-bfca-056585af5d1d req-3a670833-b96f-48a1-a1b8-ec504983642a service nova] Creating event network-vif-unplugged:1ac0a834-cdf8-45d5-b1de-b010bb6c8485 for instance e306d8c2-449e-43db-8e98-53d049726ddc on hv-cinder-79987 Jul 14 20:37:26.284319 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-4055ea72-7f09-4e15-bfca-056585af5d1d req-3a670833-b96f-48a1-a1b8-ec504983642a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034606 Jul 14 20:37:26.284927 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 177/363] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:26.484630 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:26.485228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:26.491876 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:26.492331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:26.493127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:26.493571 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:26.545571 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:26.547053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:26.553955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:26.554406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:26.555219 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:26.555662 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:26.667757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:26.676530 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:26.678058 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:26.679275 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9ec851e1-f752-4b0e-9780-133b6b0edc1e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1722 microversion: 2.20 time: 0.199063 Jul 14 20:37:26.679849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 187/364] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:26 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:26.714598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:26.722679 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f666d046-73a9-40bd-a910-7172908df4e0 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1502 microversion: 2.1 time: 0.181430 Jul 14 20:37:26.723285 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 178/365] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:26 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:27.243358 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:27.243973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:27.250527 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:27.251136 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:27.251990 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:27.252497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:27.395456 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:27.403509 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7f4770d4-0f1c-48f2-8807-090d99a4db39 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.163814 Jul 14 20:37:27.404211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 188/366] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:27 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:27.697699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:27.698329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:27.705584 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:27.706029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:27.706788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:27.707256 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:27.739701 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:27.740310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:27.747016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:27.747472 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:27.748250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:27.748689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:27.881226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:27.889743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:27.891397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:27.892592 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-14fd6f5b-64bf-4ea8-acd2-cc1cf21839a4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1722 microversion: 2.20 time: 0.198797 Jul 14 20:37:27.893154 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 179/367] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:27 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:27.910835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:27.918361 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-242d0ef4-f1d4-4835-9b52-e890c742a466 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1502 microversion: 2.1 time: 0.182416 Jul 14 20:37:27.918925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 189/368] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:27 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:28.420559 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:28.421157 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:28.429072 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:28.429523 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:28.430439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:28.430768 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:28.590975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:28.602297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c5702a0c-9a37-4f2d-bafb-1dec1703d22f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.185084 Jul 14 20:37:28.603420 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 180/369] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:28 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:28.911704 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:28.912371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:28.918798 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:28.919291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:28.920078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:28.920519 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:28.935844 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:28.936704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:28.943403 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:28.944006 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:28.944794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:28.945340 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.136397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.144468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.154274 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-bf0d7abd-3b21-4533-a5a4-68e30c907375 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 200 len: 1502 microversion: 2.1 time: 0.222193 Jul 14 20:37:29.155537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 181/370] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:28 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:29.168588 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.172382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.173958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f3d9259f-04ba-4a50-8ceb-9b1388fe3d63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1665 microversion: 2.20 time: 0.266155 Jul 14 20:37:29.186978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 190/371] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:28 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1665 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:29.196641 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0959e144-47a1-4dfb-ac46-8bebb703d679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d04e3791-dc75-4cee-bdee-0646afa05c5a"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:29.197799 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0959e144-47a1-4dfb-ac46-8bebb703d679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:29.205531 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0959e144-47a1-4dfb-ac46-8bebb703d679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.205531 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0959e144-47a1-4dfb-ac46-8bebb703d679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.206286 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0959e144-47a1-4dfb-ac46-8bebb703d679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.206723 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0959e144-47a1-4dfb-ac46-8bebb703d679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.270420 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-bcdff7c8-a5c1-4a8f-91c7-d47541cfdf78 req-4823db7f-a781-453a-b948-d287b7818806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce9f3a8-8bf1-45b7-b55c-e523c2a8169c", "name": "network-vif-deleted", "tag": "5c3557db-3eb0-46b0-9b54-a465dc81f9b2"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:29.283992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-bcdff7c8-a5c1-4a8f-91c7-d47541cfdf78 req-4823db7f-a781-453a-b948-d287b7818806 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.284799 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-bcdff7c8-a5c1-4a8f-91c7-d47541cfdf78 req-4823db7f-a781-453a-b948-d287b7818806 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.302238 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-bcdff7c8-a5c1-4a8f-91c7-d47541cfdf78 req-4823db7f-a781-453a-b948-d287b7818806 service nova] Creating event network-vif-deleted:5c3557db-3eb0-46b0-9b54-a465dc81f9b2 for instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c on hv-cinder-79987 Jul 14 20:37:29.307876 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-bcdff7c8-a5c1-4a8f-91c7-d47541cfdf78 req-4823db7f-a781-453a-b948-d287b7818806 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042069 Jul 14 20:37:29.308619 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 191/372] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:37:29.508392 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0959e144-47a1-4dfb-ac46-8bebb703d679 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316279 Jul 14 20:37:29.508987 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 182/373] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Jul 14 20:37:29 2022] POST /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments => generated 188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:37:29.621478 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:29.621888 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-50b49d08-4095-4ce2-b71b-b6017cf68b87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:29.622090 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:29.622467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-50b49d08-4095-4ce2-b71b-b6017cf68b87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:29.624428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:29.629794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.630306 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.631179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.631616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.634599 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50b49d08-4095-4ce2-b71b-b6017cf68b87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.635582 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50b49d08-4095-4ce2-b71b-b6017cf68b87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.635932 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50b49d08-4095-4ce2-b71b-b6017cf68b87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.636372 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50b49d08-4095-4ce2-b71b-b6017cf68b87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.751161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-50b49d08-4095-4ce2-b71b-b6017cf68b87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/action" status: 202 len: 0 microversion: 2.20 time: 0.132824 Jul 14 20:37:29.755207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 192/374] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 14 20:37:29 2022] POST /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 20:37:29.765665 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:29.766838 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:29.779378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.780393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.782633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:29.783478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:29.797384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.808178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-022e27eb-dda6-4a43-82e7-2b56b4fa4ee4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.190189 Jul 14 20:37:29.822986 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 183/375] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:29 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:29.974575 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.983261 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.985392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:29.986560 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ac7dbd12-0639-486c-8256-d8493468638e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1751 microversion: 2.20 time: 0.229747 Jul 14 20:37:29.987188 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 193/376] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:29 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:30.180089 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:30.180704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: fce9f3a8-8bf1-45b7-b55c-e523c2a8169c] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:30.188029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:30.188487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:30.189280 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:30.189722 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:30.203828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] HTTP exception thrown: Instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c could not be found. Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Request method failure captured: Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c HTTP/1.1 Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H5we1BtTH4O_Sj-f65jnbO2YfuEnGX4wMdfbksF9yHVEwP46h0ElCLAH0mcnkXlamdnf5NG-zWGmIAs56yZGVG321b7N4q3AfRdcxvEiED1BNggjZXKnCTNQKiq3D2mLVIi81I9ioCLn5LFa-00WaKLfPdL2zGuHrW9lmC_X2m6TZU Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 806c059a19044c6ebcd8f2cc50d9591d Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesActionsTest-1615241502 Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:37:30.205417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/806c059a19044c6ebcd8f2cc50d9591d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/806c059a19044c6ebcd8f2cc50d9591d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/806c059a19044c6ebcd8f2cc50d9591d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_806c059a19044c6ebcd8f2cc50d9591d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesActionsTest-1615241502 Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 806c059a19044c6ebcd8f2cc50d9591d Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesActionsTest-1615241502 Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesActionsTest-1615241502-project Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 1c8fa181da604f8cb41837dd570f9510 Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesActionsTest-1615241502-project Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c could not be found. Jul 14 20:37:30.207103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'fce9f3a8-8bf1-45b7-b55c-e523c2a8169c'} Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c could not be found. Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:37:30.207980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c could not be found. Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c could not be found. Jul 14 20:37:30.209297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:30.211150 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Returning 404 to user: Instance fce9f3a8-8bf1-45b7-b55c-e523c2a8169c could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:37:30.211150 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-368026c9-efc4-4ac6-bf44-4bab3343c06a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c" status: 404 len: 111 microversion: 2.1 time: 0.030581 Jul 14 20:37:30.211150 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 184/377] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:30 2022] GET /compute/v2.1/servers/fce9f3a8-8bf1-45b7-b55c-e523c2a8169c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:37:30.269405 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1180487733", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "networks": [{"uuid": "74d902ae-4216-4f44-80f4-fe09909794ea"}]}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:30.338713 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] validate_networks() for [('74d902ae-4216-4f44-80f4-fe09909794ea', None, None, None, None, None)] {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:37:30.371485 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-7e43f693-5936-4640-bb6b-71ab350f515e req-a53f9557-a347-4384-9c60-209549e95855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f144a8-c1b4-424d-80f0-da744bd56947", "name": "network-vif-plugged", "status": "completed", "tag": "6a85c30d-87e7-49c7-9ba4-5135c2402791"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:30.381690 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-7e43f693-5936-4640-bb6b-71ab350f515e req-a53f9557-a347-4384-9c60-209549e95855 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:30.382688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-7e43f693-5936-4640-bb6b-71ab350f515e req-a53f9557-a347-4384-9c60-209549e95855 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:30.399170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-7e43f693-5936-4640-bb6b-71ab350f515e req-a53f9557-a347-4384-9c60-209549e95855 service nova] Creating event network-vif-plugged:6a85c30d-87e7-49c7-9ba4-5135c2402791 for instance b3f144a8-c1b4-424d-80f0-da744bd56947 on hv-cinder-79987 Jul 14 20:37:30.412112 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-7e43f693-5936-4640-bb6b-71ab350f515e req-a53f9557-a347-4384-9c60-209549e95855 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043990 Jul 14 20:37:30.413703 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 185/378] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:30.805800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:37:30.806402 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:37:30.807170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:37:30.807698 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:37:30.808135 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:37:30.819192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:30.819651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:30.820463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:30.820907 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:30.830378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:30.831103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:30.837811 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:30.838260 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:30.839097 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:30.839542 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:30.840649 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Getting quotas for project 806c059a19044c6ebcd8f2cc50d9591d. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:37:30.846051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Getting quotas for user 1c8fa181da604f8cb41837dd570f9510 and project 806c059a19044c6ebcd8f2cc50d9591d. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:37:30.860514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:37:30.863090 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:37:30.924498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-67b0ce0e-7bb5-468e-98b8-862b878a6565 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662429 Jul 14 20:37:30.925480 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 194/379] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:37:30.940971 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5af80801-586d-41c8-b246-125fbfef6681 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:30.941760 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5af80801-586d-41c8-b246-125fbfef6681 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:31.006854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:31.018493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-233fbcd3-eb9e-41b0-8d84-9e5bdc8c82b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1267 microversion: 2.1 time: 0.192002 Jul 14 20:37:31.019621 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 186/380] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:30 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:31.027654 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:31.028496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:31.029089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5af80801-586d-41c8-b246-125fbfef6681 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:31.035709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:31.036279 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:31.036917 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5af80801-586d-41c8-b246-125fbfef6681 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1214 microversion: 2.1 time: 0.103420 Jul 14 20:37:31.037215 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:31.037500 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 195/381] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:30 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:31.037722 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:31.198594 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:31.207159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:31.208684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:31.209839 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-316937b0-a251-4aa6-9d8c-09a90ba34f58 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1751 microversion: 2.20 time: 0.187326 Jul 14 20:37:31.210397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 187/382] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:31 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:32.036778 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:32.037394 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:32.044786 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.045240 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.046016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.047027 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.054729 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:32.055427 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:32.061668 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.062199 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.062987 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.063449 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.144276 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:32.152609 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3adb0acd-5f6c-4d1b-939d-130fc8c95aeb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1266 microversion: 2.1 time: 0.101685 Jul 14 20:37:32.153310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 188/383] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:32 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:32.214283 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:32.223418 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a6ee0ee6-1935-4ef4-afac-d6f78a39d526 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1454 microversion: 2.1 time: 0.190262 Jul 14 20:37:32.224027 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 196/384] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:32 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:32.228107 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:32.228716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:32.236664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.237034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.237816 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.238251 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.241242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:32.241863 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:32.248369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.248834 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.249630 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:32.250074 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:32.444004 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:32.448295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:32.453078 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:32.454613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:32.455797 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-32405d05-f9ea-4627-90ba-cf355e5bc7f5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1753 microversion: 2.20 time: 0.231667 Jul 14 20:37:32.456356 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 189/385] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:32 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1753 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:32.456504 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-513eece7-80f1-4630-ae06-b7a9d356c57d tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1454 microversion: 2.1 time: 0.219157 Jul 14 20:37:32.456974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 197/386] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:32 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1454 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:33.170226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:33.171234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:33.179935 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:33.180559 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:33.182717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:33.183205 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:33.279465 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:33.290694 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-60ecabd8-e1d4-401a-aad7-121f71da94fb tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1272 microversion: 2.1 time: 0.124586 Jul 14 20:37:33.291706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 190/387] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:33 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:33.475448 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:33.476067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:33.482957 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:33.483459 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:33.484869 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:33.485498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:33.681741 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:33.692263 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:33.694426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:33.696066 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5ec324a3-58e3-4b7b-a32a-c093772db53f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.224590 Jul 14 20:37:33.696900 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 198/388] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:33 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:34.308808 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:34.309605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:34.313147 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:34.321668 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:34.322429 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:34.323242 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:34.323842 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:34.327876 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:34.501009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-6a3d63fd-ddea-43c6-9f13-680c5bea317c req-584f13ef-6b1a-4604-9cd4-0b9165682b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5558f068-bcdd-4f6f-9ba5-5ca4506a674e", "tag": "33d6be8c-fba7-40b4-916d-feda88f8caec"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:34.512627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-6a3d63fd-ddea-43c6-9f13-680c5bea317c req-584f13ef-6b1a-4604-9cd4-0b9165682b6e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:34.513213 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-6a3d63fd-ddea-43c6-9f13-680c5bea317c req-584f13ef-6b1a-4604-9cd4-0b9165682b6e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:34.528182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-6a3d63fd-ddea-43c6-9f13-680c5bea317c req-584f13ef-6b1a-4604-9cd4-0b9165682b6e service nova] Creating event network-changed:33d6be8c-fba7-40b4-916d-feda88f8caec for instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e on hv-cinder-79987 Jul 14 20:37:34.533906 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-6a3d63fd-ddea-43c6-9f13-680c5bea317c req-584f13ef-6b1a-4604-9cd4-0b9165682b6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038341 Jul 14 20:37:34.537797 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 199/389] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:34.716228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:34.717288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:34.725230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:34.725672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:34.726855 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:34.727571 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:34.729527 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:34.747946 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e3ce5381-2b84-4dd5-8185-88f000b551b4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.443656 Jul 14 20:37:34.749191 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:34.750024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 191/390] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:34 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:37:35.059610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:35.069132 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:35.070672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:35.071916 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-95d8cbe0-011b-47fa-b8b0-a027a8dcb612 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.360286 Jul 14 20:37:35.072481 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 200/391] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:34 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:35.266380 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-2f9ec042-4067-4779-8b2c-8e741d5d40a2 req-0cb58085-dc4f-4434-89d0-8a7e9c812553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f144a8-c1b4-424d-80f0-da744bd56947", "tag": "6a85c30d-87e7-49c7-9ba4-5135c2402791"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:35.275531 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-2f9ec042-4067-4779-8b2c-8e741d5d40a2 req-0cb58085-dc4f-4434-89d0-8a7e9c812553 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:35.275970 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-2f9ec042-4067-4779-8b2c-8e741d5d40a2 req-0cb58085-dc4f-4434-89d0-8a7e9c812553 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:35.287926 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-2f9ec042-4067-4779-8b2c-8e741d5d40a2 req-0cb58085-dc4f-4434-89d0-8a7e9c812553 service nova] Creating event network-changed:6a85c30d-87e7-49c7-9ba4-5135c2402791 for instance b3f144a8-c1b4-424d-80f0-da744bd56947 on hv-cinder-79987 Jul 14 20:37:35.293220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-2f9ec042-4067-4779-8b2c-8e741d5d40a2 req-0cb58085-dc4f-4434-89d0-8a7e9c812553 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031446 Jul 14 20:37:35.293809 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 192/392] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:35.766513 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:35.767153 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:35.774231 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:35.774658 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:35.775488 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:35.775925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:35.944964 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:35.954496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9518c90f-9925-4453-8c98-df780c59edc4 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.192381 Jul 14 20:37:35.955285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 201/393] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:35 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:36.090824 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:36.091693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:36.098543 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:36.099237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:36.100250 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:36.100876 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:36.356294 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:36.366801 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:36.368708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:36.369988 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7cf505f8-dbd1-48c3-a7a6-83e60bdc3224 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.283983 Jul 14 20:37:36.371029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 193/394] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:36 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:36.973654 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:36.974223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:36.980672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:36.981114 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:36.981876 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:36.982310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:37.152570 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:37.160875 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9ccf410f-feca-4359-9a17-56b97cdb1e37 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.190280 Jul 14 20:37:37.161577 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 202/395] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:36 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:37.388341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:37.389794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:37.397413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:37.398179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:37.399292 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:37.399882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:37.606135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:37.618128 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:37.619749 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:37.621312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0ac01988-e80f-4e27-a300-ed3b9d4f98ea tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.236512 Jul 14 20:37:37.622759 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 194/396] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:37 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:38.179165 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:38.180605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:38.188277 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:38.188901 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:38.189685 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:38.190158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:38.358344 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:38.367320 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-80b1302c-edef-49c2-a2ae-44e0929497dd tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.193270 Jul 14 20:37:38.368475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 203/397] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:38 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:38.643801 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:38.644842 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:38.652519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:38.653052 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:38.654061 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:38.654563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:38.800738 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:38.809587 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:38.811113 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:38.812873 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-646e1246-205b-4757-bc98-d487263cbe18 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.175998 Jul 14 20:37:38.813426 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 195/398] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:38 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:39.384825 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:39.385428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:39.391916 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:39.392374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:39.393160 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:39.393594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:39.555542 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:39.563508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a4085ba1-2bd8-49cf-9d9c-7e83dc615eff tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.182456 Jul 14 20:37:39.564282 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 204/399] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:39 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:39.831183 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:39.831874 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:39.838452 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:39.838902 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:39.839712 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:39.840153 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:39.978029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:39.987810 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:39.989312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:39.990525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5606ab04-9e84-43f7-b94a-f1b527303851 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.163332 Jul 14 20:37:39.995914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 196/400] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:39 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:40.420566 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-2523dd32-cb21-4db8-a6a4-a65dd1485d65 req-1353dd05-5fb2-4f74-bb1e-6bc2e44a8b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5558f068-bcdd-4f6f-9ba5-5ca4506a674e", "name": "network-vif-plugged", "status": "completed", "tag": "33d6be8c-fba7-40b4-916d-feda88f8caec"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:40.430992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-2523dd32-cb21-4db8-a6a4-a65dd1485d65 req-1353dd05-5fb2-4f74-bb1e-6bc2e44a8b6b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:40.431851 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-2523dd32-cb21-4db8-a6a4-a65dd1485d65 req-1353dd05-5fb2-4f74-bb1e-6bc2e44a8b6b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:40.445924 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-2523dd32-cb21-4db8-a6a4-a65dd1485d65 req-1353dd05-5fb2-4f74-bb1e-6bc2e44a8b6b service nova] Creating event network-vif-plugged:33d6be8c-fba7-40b4-916d-feda88f8caec for instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e on hv-cinder-79987 Jul 14 20:37:40.451078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-2523dd32-cb21-4db8-a6a4-a65dd1485d65 req-1353dd05-5fb2-4f74-bb1e-6bc2e44a8b6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Jul 14 20:37:40.452226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 205/401] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:40.580913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:40.581520 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:40.587847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:40.588305 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:40.589079 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:40.589526 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:40.741243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:40.749320 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fe87dead-5d36-4b91-ac5d-308a8c3000d7 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.172831 Jul 14 20:37:40.753121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 197/402] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:40 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:41.006425 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:41.010957 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:41.011687 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:41.018499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:41.018964 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:41.019784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:41.029708 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:41.034745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=8 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:41.180760 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:41.196832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:41.199979 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:41.203910 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-157a8119-cc72-437b-b647-cf544de9b0e7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.196374 Jul 14 20:37:41.206322 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 206/403] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:41 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:41.767689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:41.768286 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:41.775221 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:41.775671 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:41.776445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:41.776877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:41.918627 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:41.930621 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3ab01f93-a292-4c9d-85f5-77e65a9a5def tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.166875 Jul 14 20:37:41.932226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 198/404] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:41 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:42.224600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:42.225199 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:42.232276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:42.233113 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:42.234168 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:42.234759 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:42.387136 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:42.397946 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:42.400094 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:42.401855 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-658f8c3d-fdcd-4449-a44b-c2a102cda644 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.181178 Jul 14 20:37:42.403010 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 207/405] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:42 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:42.948431 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:42.949901 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:42.957848 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:42.958624 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:42.959541 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:42.959982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:43.096458 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:43.106387 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-088849ac-b269-4478-9310-35af5f44fb1a tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.161976 Jul 14 20:37:43.107567 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 199/406] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:42 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:43.421508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:43.422103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:43.429614 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:43.430574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:43.431845 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:43.432641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:43.582741 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:43.592014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:43.593775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:43.594870 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ec953ec4-10ec-4e84-bfd1-0593cc9cc558 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.177397 Jul 14 20:37:43.606635 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 208/407] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:43 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:44.124274 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:44.124892 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:44.132277 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:44.132644 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:44.133413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:44.133850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:44.287437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:44.296368 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a7b99c78-c585-42e0-b6ba-3ac44a822b47 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.175891 Jul 14 20:37:44.297234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 200/408] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:44 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:44.614242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:44.614861 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:44.621596 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:44.622303 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:44.623288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:44.623873 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:44.772940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:44.781494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:44.783590 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:44.784795 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5cd68d4d-b90d-489a-8a71-0cd618887c2f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.175075 Jul 14 20:37:44.785352 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 209/409] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:44 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:45.319240 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:45.320010 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:45.328121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:45.328982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:45.330505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:45.331022 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:45.475366 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:45.482762 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0c5c6db8-1631-4126-91b5-b8e995b20e13 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.171428 Jul 14 20:37:45.483362 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 201/410] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:45 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:45.803349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:45.803962 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:45.810385 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:45.810832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:45.811638 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:45.812071 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:45.945003 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:45.953841 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:45.955427 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:45.956574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8c9b9ce3-e676-43cf-a262-a4e4f62e5fa8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.157160 Jul 14 20:37:45.957126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 210/411] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:45 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:46.499223 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:46.499827 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:46.506295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:46.506739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:46.507525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:46.507959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:46.643296 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:46.650804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-69eba988-7cc7-4056-b24a-c998ce3c1573 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.155487 Jul 14 20:37:46.651385 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 202/412] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:46 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:46.975062 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:46.975680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:46.982198 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:46.982652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:46.983469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:46.983921 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:47.197382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:47.206081 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:47.207611 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:47.208774 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-06835b94-b2de-4b0f-ad9d-3a9247ed36c5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.237850 Jul 14 20:37:47.209336 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 211/413] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:46 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:47.667882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:47.668480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:47.675606 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:47.676050 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:47.676813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:47.677245 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:47.803370 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:47.810694 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e872c0aa-05ed-4c43-9a5b-fb67d5bf90b2 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.146766 Jul 14 20:37:47.811276 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 203/414] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:47 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:48.227425 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:48.228035 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:48.234539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:48.235024 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:48.235801 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:48.236240 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:48.377565 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:48.386259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:48.387817 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:48.388989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-29356d5a-8f33-4f05-b5d7-fb4860f5cffa tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.165437 Jul 14 20:37:48.389663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 212/415] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:48 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:48.827500 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:48.828091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:48.834965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:48.835408 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:48.836171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:48.836603 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:48.976033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:48.984445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cd4545ce-0a35-4606-8dea-16f20ca94d64 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1314 microversion: 2.1 time: 0.160853 Jul 14 20:37:48.985014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 204/416] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:48 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:49.409433 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:49.410031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:49.416148 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:49.416601 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:49.417365 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:49.417803 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:49.545353 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:49.554117 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:49.555677 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:49.556840 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6a6a12d3-b3a4-4d9a-a21c-0d5e695b2136 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.152497 Jul 14 20:37:49.557407 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 213/417] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:49 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:50.001612 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:50.002224 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:50.008819 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.009265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:50.010031 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.010468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:50.146210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:50.153742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-860d8816-2ba4-4091-913f-11d499c9c0ac tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1497 microversion: 2.1 time: 0.156050 Jul 14 20:37:50.154343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 205/418] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:49 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:50.575450 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:50.576060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:50.583877 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.584335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:50.585412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.585884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:50.726205 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:50.734890 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:50.736459 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:50.737621 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0318801d-862f-40c7-84a7-250d3d753c63 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.166107 Jul 14 20:37:50.738183 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 214/419] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:50 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:50.807685 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:50.808189 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:50.814253 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.814707 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:50.815517 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.815959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:50.840747 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:37:50.889942 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:50.919484 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f022459a-d7cd-4c03-a9b9-0d28bc1effdf tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 204 len: 0 microversion: 2.1 time: 0.115215 Jul 14 20:37:50.920059 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 206/420] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:37:50 2022] DELETE /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:37:50.928348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:50.928959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:50.935020 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.935474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:50.936281 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:50.936724 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:51.063984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:51.071919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-06f0e085-9e6b-4175-bb9f-59a5067f1eca tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1503 microversion: 2.1 time: 0.147447 Jul 14 20:37:51.072478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 215/421] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:50 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:51.759592 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:51.760492 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:51.766729 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:51.767197 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:51.768018 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:51.768449 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:51.899900 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:51.909914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:51.910410 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:51.911619 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f752f3c6-e29f-4824-b6c4-443128977cec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.156779 Jul 14 20:37:51.912193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 207/422] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:51 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:52.089383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:52.089984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:52.096935 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:52.097376 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:52.098133 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:52.098564 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:52.226573 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:52.234134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-fc12c8d8-2041-47d9-8224-34d87fc1d922 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1503 microversion: 2.1 time: 0.148534 Jul 14 20:37:52.234643 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 216/423] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:52 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:52.931005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:52.931546 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:52.938185 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:52.938640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:52.939489 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:52.940476 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:53.071959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:53.080895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:53.082388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:53.083585 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3df4ce1d-f311-4de2-a473-f67e64c6282f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.156557 Jul 14 20:37:53.084149 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 208/424] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:52 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:53.250844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:53.251501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:53.258009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:53.258454 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:53.259272 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:53.259698 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:53.387498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:53.390874 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:37:53.396616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dfa0ed73-b886-4d48-9998-170e2cdcf3ef tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1503 microversion: 2.1 time: 0.149586 Jul 14 20:37:53.397188 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 217/425] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:53 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:54.102640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:54.103267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:54.110104 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:54.110553 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:54.112018 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:54.112454 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:54.412194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:54.413683 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:54.415137 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:54.421013 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:54.421886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:54.422381 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:54.422511 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:54.423128 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:54.423563 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:54.424169 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-98ee04b6-f934-4295-82c9-7004ff137c26 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.324856 Jul 14 20:37:54.424922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 209/426] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:54 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:54.614848 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8fa181da604f8cb41837dd570f9510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806c059a19044c6ebcd8f2cc50d9591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:54.622319 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-38965b7c-6ceb-4c65-b2d7-88a522e71e7d tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 200 len: 1503 microversion: 2.1 time: 0.212644 Jul 14 20:37:54.622891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 218/427] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:54 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:37:54.725456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-3eec068c-87ab-4e78-a2d5-8ff699daf2a0 req-f9ccbfc5-8bb8-4747-a976-c23ce9a6f915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5558f068-bcdd-4f6f-9ba5-5ca4506a674e", "name": "network-vif-deleted", "tag": "33d6be8c-fba7-40b4-916d-feda88f8caec"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:37:54.734442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3eec068c-87ab-4e78-a2d5-8ff699daf2a0 req-f9ccbfc5-8bb8-4747-a976-c23ce9a6f915 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:54.735051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3eec068c-87ab-4e78-a2d5-8ff699daf2a0 req-f9ccbfc5-8bb8-4747-a976-c23ce9a6f915 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:54.747505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-3eec068c-87ab-4e78-a2d5-8ff699daf2a0 req-f9ccbfc5-8bb8-4747-a976-c23ce9a6f915 service nova] Creating event network-vif-deleted:33d6be8c-fba7-40b4-916d-feda88f8caec for instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e on hv-cinder-79987 Jul 14 20:37:54.753220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-3eec068c-87ab-4e78-a2d5-8ff699daf2a0 req-f9ccbfc5-8bb8-4747-a976-c23ce9a6f915 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031270 Jul 14 20:37:54.754109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 210/428] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:37:55.442655 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:55.443223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:55.449903 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:55.450384 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:55.451184 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:55.451624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:55.597212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:55.606211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:55.607820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:55.609005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2c0e5937-2601-42da-ad79-3a0ea1a8dd73 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.170415 Jul 14 20:37:55.609782 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 219/429] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:55 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:55.641234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:55.642053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] [instance: 5558f068-bcdd-4f6f-9ba5-5ca4506a674e] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:55.649111 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:55.649565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:55.650336 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:55.650772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:55.664639 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] HTTP exception thrown: Instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e could not be found. Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Request method failure captured: Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e HTTP/1.1 Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H5we1BtTH4O_Sj-f65jnbO2YfuEnGX4wMdfbksF9yHVEwP46h0ElCLAH0mcnkXlamdnf5NG-zWGmIAs56yZGVG321b7N4q3AfRdcxvEiED1BNggjZXKnCTNQKiq3D2mLVIi81I9ioCLn5LFa-00WaKLfPdL2zGuHrW9lmC_X2m6TZU Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 806c059a19044c6ebcd8f2cc50d9591d Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesActionsTest-1615241502 Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:37:55.666423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/806c059a19044c6ebcd8f2cc50d9591d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/806c059a19044c6ebcd8f2cc50d9591d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/806c059a19044c6ebcd8f2cc50d9591d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_806c059a19044c6ebcd8f2cc50d9591d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesActionsTest-1615241502 Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 806c059a19044c6ebcd8f2cc50d9591d Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesActionsTest-1615241502 Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesActionsTest-1615241502-project Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 1c8fa181da604f8cb41837dd570f9510 Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesActionsTest-1615241502-project Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e could not be found. Jul 14 20:37:55.667984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '5558f068-bcdd-4f6f-9ba5-5ca4506a674e'} Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e could not be found. Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:37:55.668696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e could not be found. Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e could not be found. Jul 14 20:37:55.669939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:37:55.671061 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] Returning 404 to user: Instance 5558f068-bcdd-4f6f-9ba5-5ca4506a674e could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:37:55.671061 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9cf3e15c-2b0e-4f24-88ae-5d46e4e7e614 tempest-VolumesActionsTest-1615241502 tempest-VolumesActionsTest-1615241502-project] 10.222.0.52 "GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e" status: 404 len: 111 microversion: 2.1 time: 0.031856 Jul 14 20:37:55.671061 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 211/430] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:37:55 2022] GET /compute/v2.1/servers/5558f068-bcdd-4f6f-9ba5-5ca4506a674e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:37:56.628331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:56.628940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:56.635667 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:56.636098 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:56.636875 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:56.637312 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:56.773736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:56.782355 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:56.784560 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:56.785729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7c0e9e90-ced4-4d16-b27d-f339184301b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.161788 Jul 14 20:37:56.786291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 220/431] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:56 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:37:57.804548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:57.805155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:57.811801 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:57.812251 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:57.813017 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:57.813455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:57.943605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:57.952141 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:57.953651 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:57.954792 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-836c438f-1325-4311-ba10-f801c01f2b35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.154155 Jul 14 20:37:57.955415 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 212/432] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:57 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:37:58.973865 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:37:58.974641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:37:58.982364 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:58.982961 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:58.983830 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:37:58.984398 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:37:59.117080 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:59.125690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:59.127227 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:37:59.128380 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f9b46f1f-069a-4e5b-947d-e0a8c3f638eb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.158992 Jul 14 20:37:59.128940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 221/433] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:37:58 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:00.147091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:00.147641 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:00.154410 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:00.154981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:00.155800 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:00.156247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:00.296935 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:00.306386 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:00.307936 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:00.309095 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9b6fdf27-ed04-45e0-85af-02431cdb11d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.166419 Jul 14 20:38:00.309653 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 213/434] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:00 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:01.336159 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:01.340784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:01.361845 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:01.376291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:01.377889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:01.378849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:01.379648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:01.519538 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-578ed635-4c6c-4b6f-80f8-f26e55a23567 req-d71f4ce2-2a43-42de-84a1-c0a6cf515bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e306d8c2-449e-43db-8e98-53d049726ddc", "name": "network-vif-plugged", "status": "completed", "tag": "1ac0a834-cdf8-45d5-b1de-b010bb6c8485"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:01.531006 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-578ed635-4c6c-4b6f-80f8-f26e55a23567 req-d71f4ce2-2a43-42de-84a1-c0a6cf515bc7 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:01.531720 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-578ed635-4c6c-4b6f-80f8-f26e55a23567 req-d71f4ce2-2a43-42de-84a1-c0a6cf515bc7 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:01.549588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-578ed635-4c6c-4b6f-80f8-f26e55a23567 req-d71f4ce2-2a43-42de-84a1-c0a6cf515bc7 service nova] Creating event network-vif-plugged:1ac0a834-cdf8-45d5-b1de-b010bb6c8485 for instance e306d8c2-449e-43db-8e98-53d049726ddc on hv-cinder-79987 Jul 14 20:38:01.555023 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:01.563510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-578ed635-4c6c-4b6f-80f8-f26e55a23567 req-d71f4ce2-2a43-42de-84a1-c0a6cf515bc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048962 Jul 14 20:38:01.565345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 214/435] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:38:01.568580 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:01.570350 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:01.571645 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-04964df8-bc06-4eed-b40a-3c1148af8c35 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.242574 Jul 14 20:38:01.572307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 222/436] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:01 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:02.590955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:02.591573 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:02.599337 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:02.600171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:02.601157 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:02.601610 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:02.800467 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:02.817646 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:02.819220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:02.820605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ee83086c-304b-4739-b7ee-c9764590c1b8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.234655 Jul 14 20:38:02.821781 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 215/437] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:02 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:03.445474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ae66cdb3-b71d-460f-94da-3bb67d30f6a2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bfecb25-d500-4d15-ab4b-28a230ef874a"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:03.446546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ae66cdb3-b71d-460f-94da-3bb67d30f6a2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:03.453722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae66cdb3-b71d-460f-94da-3bb67d30f6a2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:03.454248 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae66cdb3-b71d-460f-94da-3bb67d30f6a2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:03.455639 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae66cdb3-b71d-460f-94da-3bb67d30f6a2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:03.456086 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ae66cdb3-b71d-460f-94da-3bb67d30f6a2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:03.842052 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:03.843512 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:03.852746 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:03.853303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:03.854447 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:03.855207 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:04.031505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:04.042630 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:04.044521 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:04.045919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fc79907e-d076-4afa-9f22-1d9e665093a6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.209996 Jul 14 20:38:04.046469 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 216/438] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:03 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:04.604832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ae66cdb3-b71d-460f-94da-3bb67d30f6a2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.157979 Jul 14 20:38:04.607677 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 223/439] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:38:03 2022] POST /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 194 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:04.673410 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-635f3415-a953-4913-bc64-bd081c6910d5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:04.676428 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-635f3415-a953-4913-bc64-bd081c6910d5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:04.685020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:04.693884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635f3415-a953-4913-bc64-bd081c6910d5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:04.695870 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635f3415-a953-4913-bc64-bd081c6910d5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:04.696751 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635f3415-a953-4913-bc64-bd081c6910d5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:04.703184 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-635f3415-a953-4913-bc64-bd081c6910d5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:04.735717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-635f3415-a953-4913-bc64-bd081c6910d5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522/ips" status: 200 len: 149 microversion: 2.1 time: 0.067478 Jul 14 20:38:04.757491 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c08d7c2d-06af-4f9d-bc90-a68f11c7fe06"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:04.759208 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:04.762461 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 217/440] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:38:04 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522/ips => generated 149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:04.773714 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:04.774508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:04.776187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:04.776879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:04.935361 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Invalid volume: volume c08d7c2d-06af-4f9d-bc90-a68f11c7fe06 is already attached to instances: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: POST /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522/os-volume_attachments HTTP/1.1 Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 74 Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:38:04.937699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {"volumeAttachment": {"volumeId": "c08d7c2d-06af-4f9d-bc90-a68f11c7fe06"}} Jul 14 20:38:04.939244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Invalid volume: volume c08d7c2d-06af-4f9d-bc90-a68f11c7fe06 is already attached to instances: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'server_id': '78c76d46-a8ea-4bcd-91b5-d12a4bfd7522', 'body': {'volumeAttachment': {'volumeId': 'c08d7c2d-06af-4f9d-bc90-a68f11c7fe06'}}} Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c08d7c2d-06af-4f9d-bc90-a68f11c7fe06 is already attached to instances: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:04.943284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c08d7c2d-06af-4f9d-bc90-a68f11c7fe06 is already attached to instances: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:04.944690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:04.946250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:04.946250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:38:04.946250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:38:04.946250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c08d7c2d-06af-4f9d-bc90-a68f11c7fe06 is already attached to instances: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 Jul 14 20:38:04.946250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:04.946250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 400 to user: Invalid volume: volume c08d7c2d-06af-4f9d-bc90-a68f11c7fe06 is already attached to instances: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:38:04.946250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d12a6b4b-77ab-4ddd-99a2-f7364fad51aa tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.193686 Jul 14 20:38:04.949268 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:04.954479 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:04.955809 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 224/441] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:38:04 2022] POST /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522/os-volume_attachments => generated 174 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:38:04.961344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:04.961541 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:04.963068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:04.963523 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:05.033783 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:38:05.064525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:05.065377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:05.076294 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:05.076743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:05.077727 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:05.078240 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:05.193822 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7e3b732d-135f-4069-900c-86990f97f5c7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 204 len: 0 microversion: 2.1 time: 0.247226 Jul 14 20:38:05.196085 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 218/442] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:38:04 2022] DELETE /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:38:05.221481 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:05.222612 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:05.240616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:05.246101 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:05.247713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:05.248362 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:05.431098 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:05.442634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:05.448473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:05.449982 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:05.451178 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6c749d1a-886d-47ef-bc71-8fb7d52a53ad tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.390561 Jul 14 20:38:05.451729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 225/443] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:05 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:38:05.452100 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a0216d7e-ff96-4e96-be84-0d2550ea836f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1680 microversion: 2.1 time: 0.244716 Jul 14 20:38:05.463726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 219/444] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:05 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:06.469908 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:06.471570 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:06.471726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:06.472211 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:06.479252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:06.479550 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:06.479774 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:06.480324 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:06.480697 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:06.481204 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:06.481601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:06.482187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:06.698434 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:06.705178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:06.709275 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:06.711647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:06.713506 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e438b7c7-9c74-4c5d-b9e7-6cda0ee92ff5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1809 microversion: 2.20 time: 0.247561 Jul 14 20:38:06.725457 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5d0cb48b-6341-467f-9e2a-2a49c57e2ee7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1680 microversion: 2.1 time: 0.247920 Jul 14 20:38:06.725457 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 220/445] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:06 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:06.726426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 226/446] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:06 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:07.737630 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:07.738453 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:07.739124 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:07.740397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:07.751053 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:07.752315 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:07.753833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:07.754618 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:07.762721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:07.763478 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:07.764776 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:07.765510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:08.187621 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:08.200201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f7b592ef-c618-48b0-a251-7d9763db08c2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1680 microversion: 2.1 time: 0.470437 Jul 14 20:38:08.201400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 221/447] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:07 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1680 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:08.219834 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:08.230570 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:08.232211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:08.233396 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-09a72bf8-1eda-43ba-af98-7f8612fd96d5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1796 microversion: 2.20 time: 0.503102 Jul 14 20:38:08.233954 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 227/448] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:07 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1796 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:08.765471 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-0dba4b37-3fdf-40eb-b402-6f37ab3f20a8 req-71c8f6fd-1041-4bbd-b2e2-c31dbcd495ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c76d46-a8ea-4bcd-91b5-d12a4bfd7522", "name": "network-vif-deleted", "tag": "33415f35-0a2b-412a-b401-659c0b757bea"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:08.790904 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-0dba4b37-3fdf-40eb-b402-6f37ab3f20a8 req-71c8f6fd-1041-4bbd-b2e2-c31dbcd495ac service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:08.793236 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-0dba4b37-3fdf-40eb-b402-6f37ab3f20a8 req-71c8f6fd-1041-4bbd-b2e2-c31dbcd495ac service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:08.814712 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-0dba4b37-3fdf-40eb-b402-6f37ab3f20a8 req-71c8f6fd-1041-4bbd-b2e2-c31dbcd495ac service nova] Creating event network-vif-deleted:33415f35-0a2b-412a-b401-659c0b757bea for instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 on hv-cinder-79987 Jul 14 20:38:08.831198 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-0dba4b37-3fdf-40eb-b402-6f37ab3f20a8 req-71c8f6fd-1041-4bbd-b2e2-c31dbcd495ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069915 Jul 14 20:38:08.831807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 222/449] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:09.143911 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:09.146228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:09.154511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:09.155569 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:09.156505 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:09.161828 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:09.195247 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lazy-loading 'flavor' on Instance uuid 6e5c8801-ed84-48a2-b248-e655089e94c3 {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:38:09.226266 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:09.226968 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:09.234098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:09.234542 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:09.235344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:09.236503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:09.332143 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:09.332846 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:09.333465 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lazy-loading 'fault' on Instance uuid 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:38:09.401205 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2df423ee-0643-4ab5-87a7-c913685f7500 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/action" status: 200 len: 32 microversion: 2.1 time: 0.261697 Jul 14 20:38:09.405703 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 228/450] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:38:09 2022] POST /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 20:38:09.425913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:09.431816 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:09.435857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:09.442230 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-85a159d9-9947-405c-98d1-ee802af89d49 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 200 len: 1330 microversion: 2.1 time: 0.220355 Jul 14 20:38:09.442984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 223/451] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:09 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 1330 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:09.462915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:09.463820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:09.465748 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:09.467088 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:09.918960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:09.929253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f3cc4a0e-e9cc-4a5a-9b2a-d93bc8490db6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.503289 Jul 14 20:38:09.942378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 229/452] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:09 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:10.461212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:10.470014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:10.478502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:10.479005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:10.480209 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:10.480829 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:10.496873 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 HTTP/1.1 Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:38:10.498788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:38:10.500407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '78c76d46-a8ea-4bcd-91b5-d12a4bfd7522'} Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:38:10.501327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:38:10.502796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:10.505033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:38:10.506053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e0637a54-89c4-43ff-b961-2e2102080668 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 404 len: 111 microversion: 2.1 time: 0.049127 Jul 14 20:38:10.516807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9e3d4f41-7f7b-4574-baa8-73ab6b528da1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '.version_select at 0x7fafb1a5fc10>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:10.522137 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 224/453] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:10 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:38:10.545014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9e3d4f41-7f7b-4574-baa8-73ab6b528da1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662835395" status: 202 len: 0 microversion: 2.1 time: 0.033100 Jul 14 20:38:10.551740 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 230/454] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Jul 14 20:38:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662835395 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:38:10.952779 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:10.953787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:10.975687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:10.978911 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:10.980671 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:10.984477 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:10.999099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:11.269414 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:11.280686 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fb3554df-9552-4ef7-aa5d-1625650c3f7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.334588 Jul 14 20:38:11.281849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 225/455] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:10 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:11.516488 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:11.518159 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:11.529134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:11.529831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:11.530797 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:11.531271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:11.725054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lazy-loading 'services' on Instance uuid 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:38:11.796228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:11.871408 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-345627aa-427c-433d-b62d-c265ab258209 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments/c08d7c2d-06af-4f9d-bc90-a68f11c7fe06" status: 202 len: 0 microversion: 2.1 time: 0.360725 Jul 14 20:38:11.872405 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 231/456] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:38:11 2022] DELETE /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments/c08d7c2d-06af-4f9d-bc90-a68f11c7fe06 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:38:11.883996 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-61406ece-046a-4bba-aa42-44b77d51b960 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:11.886155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-61406ece-046a-4bba-aa42-44b77d51b960 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:11.896696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61406ece-046a-4bba-aa42-44b77d51b960 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:11.897663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61406ece-046a-4bba-aa42-44b77d51b960 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:11.899431 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61406ece-046a-4bba-aa42-44b77d51b960 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:11.901038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61406ece-046a-4bba-aa42-44b77d51b960 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:11.956373 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-61406ece-046a-4bba-aa42-44b77d51b960 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078427 Jul 14 20:38:11.957180 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 226/457] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:38:11 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:12.302186 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:12.303672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:12.311059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:12.311590 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:12.312700 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:12.313226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:12.474981 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:12.486093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c0b36807-1639-472d-9c61-8fac28f2efbb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.189160 Jul 14 20:38:12.487343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 232/458] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:12 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:12.968685 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-880a3795-80bf-48f0-a2c7-3372efe0351b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:12.970811 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-880a3795-80bf-48f0-a2c7-3372efe0351b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:12.977753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-880a3795-80bf-48f0-a2c7-3372efe0351b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:12.978205 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-880a3795-80bf-48f0-a2c7-3372efe0351b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:12.979007 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-880a3795-80bf-48f0-a2c7-3372efe0351b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:12.979737 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-880a3795-80bf-48f0-a2c7-3372efe0351b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:13.011203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-880a3795-80bf-48f0-a2c7-3372efe0351b tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Jul 14 20:38:13.015316 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 227/459] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:38:12 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:13.505110 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:13.505818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:13.512434 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:13.512969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:13.513824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:13.514361 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:13.685104 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:13.696853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8a1df2da-eeed-4e31-9871-124d27cbf49a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.196181 Jul 14 20:38:13.697896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 233/460] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:13 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:14.023845 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-07839c86-d43f-4d1a-a31a-06d4b00b8504 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:14.028668 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-07839c86-d43f-4d1a-a31a-06d4b00b8504 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:14.037905 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07839c86-d43f-4d1a-a31a-06d4b00b8504 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.038444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07839c86-d43f-4d1a-a31a-06d4b00b8504 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.039969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07839c86-d43f-4d1a-a31a-06d4b00b8504 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.040409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07839c86-d43f-4d1a-a31a-06d4b00b8504 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.083649 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-07839c86-d43f-4d1a-a31a-06d4b00b8504 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064129 Jul 14 20:38:14.084520 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 228/461] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:38:14 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 20:38:14.175466 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:14.175968 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:14.184659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.185807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.187479 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.188333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.231053 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:38:14.379689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-38c36a39-692d-4ae3-8e06-d3694efc4924 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 204 len: 0 microversion: 2.1 time: 0.208978 Jul 14 20:38:14.383571 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 234/462] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:38:14 2022] DELETE /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 20:38:14.388714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:14.389473 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:14.396654 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.397326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.398281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.398714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.551746 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:14.559851 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f9a3407a-37cc-420f-a088-6bff84dcbad5 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1679 microversion: 2.1 time: 0.174881 Jul 14 20:38:14.561044 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 229/463] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:14 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:14.716590 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:14.717287 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:14.725866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.727591 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:14.728195 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:14.892701 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:14.902305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c4680cab-45d7-4903-8a5e-d2dd162f86c8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.190309 Jul 14 20:38:14.903094 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 235/464] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:14 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:15.579528 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:15.580555 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:15.590908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:15.591517 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:15.592125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:15.592697 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:15.772158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:15.784453 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c58bdb5b-250f-4008-98ca-df9e38ffe058 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1679 microversion: 2.1 time: 0.210466 Jul 14 20:38:15.785374 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 230/465] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:15 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:15.922803 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:15.924127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:15.934733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:15.935663 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:15.937196 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:15.937711 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:16.115831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:16.129469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-608e10e5-35de-47c3-8e04-0a732383d506 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.210535 Jul 14 20:38:16.130225 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 236/466] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:15 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:16.805609 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:16.806647 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:16.816564 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:16.817699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:16.818922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:16.819969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:17.101441 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:17.112263 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4b2369fb-2de5-48cc-9b1c-9005b954420c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1679 microversion: 2.1 time: 0.311529 Jul 14 20:38:17.124508 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 231/467] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:16 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1679 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:17.154634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:17.156086 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:17.173938 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:17.174291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:17.174889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:17.175300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:17.668560 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:17.680406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4d878a18-2b98-4bcc-a007-55b9a1051085 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.531205 Jul 14 20:38:17.682529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 237/468] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:17 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:18.029319 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-e9c73377-5298-4edf-85df-577449036e92 req-f6392a5b-83d0-4269-b719-0a48d75fe88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad8c60a-cc83-4ab7-beab-7c1a2b31c830", "name": "network-vif-deleted", "tag": "59599dd6-29f1-4ecf-91d4-36c5c1372812"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:18.039794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-e9c73377-5298-4edf-85df-577449036e92 req-f6392a5b-83d0-4269-b719-0a48d75fe88f service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:18.040326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-e9c73377-5298-4edf-85df-577449036e92 req-f6392a5b-83d0-4269-b719-0a48d75fe88f service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:18.051625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-e9c73377-5298-4edf-85df-577449036e92 req-f6392a5b-83d0-4269-b719-0a48d75fe88f service nova] Creating event network-vif-deleted:59599dd6-29f1-4ecf-91d4-36c5c1372812 for instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 on hv-cinder-79987 Jul 14 20:38:18.057680 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-e9c73377-5298-4edf-85df-577449036e92 req-f6392a5b-83d0-4269-b719-0a48d75fe88f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031863 Jul 14 20:38:18.058527 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 232/469] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:18.131843 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:18.133843 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:18.141065 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:18.141521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:18.143252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:18.143847 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:18.225454 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:18.241498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-edee9163-cc50-43bf-a7ad-5d72d850f0b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 200 len: 1326 microversion: 2.1 time: 0.115409 Jul 14 20:38:18.242232 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 238/470] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:18 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:18.700247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:18.701040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:18.714326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:18.714787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:18.715613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:18.716059 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:18.864787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:18.875035 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0d631791-3230-4d67-9e5c-116ebe342f32 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.178538 Jul 14 20:38:18.876149 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 233/471] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:18 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:19.261784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:19.262786 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:19.273343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:19.274054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:19.274986 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:19.275477 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:19.299145 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 HTTP/1.1 Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:38:19.301978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:38:19.303538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '0ad8c60a-cc83-4ab7-beab-7c1a2b31c830'} Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:38:19.304374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:38:19.306363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:38:19.307728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:38:19.307728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-534eecb8-f290-4c6d-8f4b-1bdda431bf56 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 404 len: 111 microversion: 2.1 time: 0.049055 Jul 14 20:38:19.307728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 239/472] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:19 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:38:19.319683 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1346b8f7-c134-4fea-9a57-e44e00680c01 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '.version_select at 0x7fafb1b075e0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:19.343209 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1346b8f7-c134-4fea-9a57-e44e00680c01 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714595242" status: 202 len: 0 microversion: 2.1 time: 0.031149 Jul 14 20:38:19.343796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 234/473] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 14 20:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714595242 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:38:19.902006 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:19.902842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:19.913839 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:19.914333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:19.915108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:19.915546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:20.083556 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ee3367ee-2c1b-4e8c-a47a-f7580161c962 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: .version_select at 0x7fafb1b78b80>, body: {"keypair": {"name": "tempest-keypair-310678301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP9O2HHJk1k2+S4H1XdHLmNt4caMF52jnk4IFjZPaMZf1ckekRq1kFtv1EfSsPQd5ycrO/jYYvnT7ZeB0FY196zfCqDwIoNM7R8Yau3oPVkrOOj3Bc8NaQxSqjuAjoUBA=="}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:20.100570 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-ee3367ee-2c1b-4e8c-a47a-f7580161c962 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:38:20.107781 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-ee3367ee-2c1b-4e8c-a47a-f7580161c962 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:38:20.109073 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:20.124898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-51c3fa37-1a84-4421-8ed2-15b89eaa0e9a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.227992 Jul 14 20:38:20.125854 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 240/474] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:19 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:20.139386 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ee3367ee-2c1b-4e8c-a47a-f7580161c962 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061296 Jul 14 20:38:20.139907 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 235/475] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:38:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:21.142965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:21.143652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:21.150340 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:21.150791 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:21.151609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:21.152054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:21.452344 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:21.461053 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a615ef94-681e-4c54-bed9-2c639487b84c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.322103 Jul 14 20:38:21.461633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 241/476] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:21 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:22.038755 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-136577829", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "946dd351-5829-4dff-b5e5-6e232f299044"}], "security_groups": [{"name": "tempest-securitygroup--1064137849"}], "key_name": "tempest-keypair-310678301", "user_data": "}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:22.146221 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] validate_networks() for [('946dd351-5829-4dff-b5e5-6e232f299044', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:38:22.478840 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:22.479507 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:22.487086 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:22.487541 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:22.488334 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:22.488774 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:22.602955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:38:22.603387 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:38:22.603851 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:38:22.604261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:38:22.604838 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:38:22.613627 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:22.614073 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:22.614906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:22.615365 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:22.633564 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:38:22.638389 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:38:22.651523 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:38:22.654656 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:38:22.661600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:22.670338 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a8e35310-0eb5-4351-b50f-d18de188d310 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.195410 Jul 14 20:38:22.670912 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 242/477] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:22 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:22.712983 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b7e7209c-bbaf-4ada-b49e-a28419f0a2cb tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679219 Jul 14 20:38:22.715186 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 236/478] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:38:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:38:22.724312 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a344a183-f249-47be-b6ce-e666ad3ef9ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:22.725246 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a344a183-f249-47be-b6ce-e666ad3ef9ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:22.791026 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a344a183-f249-47be-b6ce-e666ad3ef9ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:22.798285 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a344a183-f249-47be-b6ce-e666ad3ef9ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1240 microversion: 2.1 time: 0.078331 Jul 14 20:38:22.799186 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 243/479] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:22 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:23.689530 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:23.690128 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:23.696303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:23.696745 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:23.697580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:23.698082 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:23.814686 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:23.815332 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:23.822158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:23.822615 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:23.823427 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:23.823869 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:23.829491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:23.837884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3a82aabe-1533-49ca-92fb-5db6e5940d89 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.153151 Jul 14 20:38:23.838602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 237/480] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:23 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:23.893733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:23.906026 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0012da07-97d7-49ae-84d7-02daf7e92faf tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1292 microversion: 2.1 time: 0.095009 Jul 14 20:38:23.906620 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 244/481] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:23 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:24.855826 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:24.857196 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:24.865744 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:24.866205 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:24.867073 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:24.867518 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:24.925653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:24.926465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:24.933986 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:24.934593 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:24.935755 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:24.936438 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:25.147351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:25.155571 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b79d8045-9de1-4de1-a6d5-59b74bcaf819 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.303662 Jul 14 20:38:25.165793 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 238/482] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:24 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:25.243511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:25.251340 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c9bbc3de-3d14-4880-894e-58c1306f3fd0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.330890 Jul 14 20:38:25.251927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 245/483] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:24 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:25.716216 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-2515f3cd-7271-4283-9f9a-51672a587218 req-00af292f-fdfb-4f8e-9074-1ff151fed634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f580e757-6a64-44b4-924f-3710d64601ee", "tag": "384bb2f5-be38-48f0-8c74-d068964e4b64"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:25.728282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-2515f3cd-7271-4283-9f9a-51672a587218 req-00af292f-fdfb-4f8e-9074-1ff151fed634 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:25.729420 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-2515f3cd-7271-4283-9f9a-51672a587218 req-00af292f-fdfb-4f8e-9074-1ff151fed634 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:25.752348 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-2515f3cd-7271-4283-9f9a-51672a587218 req-00af292f-fdfb-4f8e-9074-1ff151fed634 service nova] Creating event network-changed:384bb2f5-be38-48f0-8c74-d068964e4b64 for instance f580e757-6a64-44b4-924f-3710d64601ee on hv-cinder-79987 Jul 14 20:38:25.758987 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-2515f3cd-7271-4283-9f9a-51672a587218 req-00af292f-fdfb-4f8e-9074-1ff151fed634 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046153 Jul 14 20:38:25.760424 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 239/484] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:38:26.173125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:26.173787 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:26.180766 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:26.181214 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:26.181992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:26.182427 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:26.270803 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:26.271525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:26.278259 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:26.278700 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:26.279532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:26.279974 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:26.543854 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:26.552641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-79752410-a01f-4e8b-8471-db32ac6a2fe3 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.383482 Jul 14 20:38:26.553224 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 246/485] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:26 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:26.555090 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:26.562775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-aebbfd6b-5206-47e9-9d99-204c38682d6c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.297384 Jul 14 20:38:26.563545 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 240/486] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:26 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:27.570855 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:27.571741 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:27.580850 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:27.581671 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:27.582626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:27.583293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:27.585624 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:27.587717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:27.595899 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:27.596371 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:27.597508 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:27.598177 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:27.838885 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:27.848627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-92039ca3-0142-4084-af08-a813a4e14201 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.282937 Jul 14 20:38:27.849234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:27.855101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 247/487] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:27 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:27.859049 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0b49733d-c59f-464b-9285-ca037d13031f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.277873 Jul 14 20:38:27.859631 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 241/488] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:27 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:28.865532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:28.866061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:28.872866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:28.874079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:28.874817 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:28.875270 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:28.878824 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:28.889436 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:28.889693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:28.889785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:28.889785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:28.889785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:28.889785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:29.101245 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:29.104214 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:29.109902 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-13752beb-4e30-4c8b-b6e3-9c3dcab4b4ea tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.248214 Jul 14 20:38:29.111009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 248/489] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:28 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:29.114203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e71ca30a-2202-4c85-9ab9-7dfbfcae5bfe tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.240509 Jul 14 20:38:29.114684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 242/490] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:28 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:30.127978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:30.128737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:30.135538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:30.136080 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:30.136953 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:30.137473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:30.140273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:30.140912 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:30.152152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:30.153725 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:30.156206 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:30.156698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:30.350862 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:30.354807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:30.359073 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8a75b859-5636-405e-a6cf-d5666c2c4c5b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.235436 Jul 14 20:38:30.359648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 249/491] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:30 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:30.362562 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7a9f6586-b004-452b-84d4-5e113a952760 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.227401 Jul 14 20:38:30.363218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 243/492] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:30 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:31.376348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:31.376987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:31.379179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:31.379784 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:31.383607 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:31.384064 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:31.384836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:31.385275 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:31.386094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:31.386537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:31.387315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:31.387749 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:31.585189 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:31.587430 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:31.594761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ccfb1063-5861-4108-9bd1-8c075d6a8bd2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.221835 Jul 14 20:38:31.595383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 250/493] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:31 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:31.596374 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b7fb9a80-f2b5-40bd-bdcb-1def44f85124 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.221061 Jul 14 20:38:31.596934 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 244/494] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:31 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:31.623722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-895c9f7d-7924-4546-9bdb-5c0b42b78407 req-8db431f1-65f4-42f1-801c-d05a1c3d3db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f580e757-6a64-44b4-924f-3710d64601ee", "name": "network-vif-plugged", "status": "completed", "tag": "384bb2f5-be38-48f0-8c74-d068964e4b64"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:31.627593 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:31.633829 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-895c9f7d-7924-4546-9bdb-5c0b42b78407 req-8db431f1-65f4-42f1-801c-d05a1c3d3db8 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:31.633829 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-895c9f7d-7924-4546-9bdb-5c0b42b78407 req-8db431f1-65f4-42f1-801c-d05a1c3d3db8 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:31.646810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-895c9f7d-7924-4546-9bdb-5c0b42b78407 req-8db431f1-65f4-42f1-801c-d05a1c3d3db8 service nova] Creating event network-vif-plugged:384bb2f5-be38-48f0-8c74-d068964e4b64 for instance f580e757-6a64-44b4-924f-3710d64601ee on hv-cinder-79987 Jul 14 20:38:31.651772 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-895c9f7d-7924-4546-9bdb-5c0b42b78407 req-8db431f1-65f4-42f1-801c-d05a1c3d3db8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033233 Jul 14 20:38:31.652371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 251/495] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:32.612192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:32.612803 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:32.614955 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:32.615666 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:32.619427 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:32.619874 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:32.620648 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:32.621079 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:32.621799 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:32.622258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:32.623059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:32.623508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:32.625235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:32.646869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=10 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:32.795773 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:32.816307 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:32.818591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:32.823563 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:32.826470 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1c55115b-7a6f-4f6b-b359-ad3645210576 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1734 microversion: 2.1 time: 0.218749 Jul 14 20:38:32.827192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 245/496] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:32 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:32.831665 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f637452f-5c3b-4d00-baa5-e1216863f3e1 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.222849 Jul 14 20:38:32.832231 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 252/497] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:32 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:33.844058 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:33.845250 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:33.849320 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:33.849904 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:33.852856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:33.853311 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:33.854081 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:33.854510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:33.857640 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:33.858101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:33.858911 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:33.859383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:34.048304 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:34.056865 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1d934c5b-0f6f-481b-a8e4-0a2a8a27c0d2 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1714 microversion: 2.1 time: 0.216950 Jul 14 20:38:34.057443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 246/498] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:33 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1714 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:34.066712 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:34.074516 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ed78967e-420c-4834-ac3d-22ecafd22b98 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1366 microversion: 2.1 time: 0.229153 Jul 14 20:38:34.075123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 253/499] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:33 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:34.166635 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:34.167359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:34.175797 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:34.176246 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:34.177166 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:34.182434 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:34.312066 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] HTTP exception thrown: Cannot 'detach_volume' instance 6e5c8801-ed84-48a2-b248-e655089e94c3 while it is in vm_state rescued Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Request method failure captured: Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments/4bfecb25-d500-4d15-ab4b-28a230ef874a HTTP/1.1 Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3kAdV8bnoIbkfi3zXPBwAE-Yhbyqz8yki4CrvyyCbj9qY6qD9JQ8NtTQx2D1a3lJ6Ytd_IJmAAVrbrIUoqOcPSQpsgj1kCVNQo1wrmQ7oP6MGyR9evbAASgPVUvR79k9mFnfITuGEcMvh9oql-AzkgZkHKstC8gQMMiRaotA1vIfw Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:38:34.313992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cceb4db55bba4bd099104acdcb6d2762", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 765c911957bd4ca68dd520fc4fbba1c9 Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:38:34.315574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Cannot 'detach_volume' instance 6e5c8801-ed84-48a2-b248-e655089e94c3 while it is in vm_state rescued Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'server_id': '6e5c8801-ed84-48a2-b248-e655089e94c3', 'id': '4bfecb25-d500-4d15-ab4b-28a230ef874a'} Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e5c8801-ed84-48a2-b248-e655089e94c3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:38:34.316516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6e5c8801-ed84-48a2-b248-e655089e94c3 while it is in vm_state rescued Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6e5c8801-ed84-48a2-b248-e655089e94c3 while it is in vm_state rescued Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:38:34.317833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Returning 409 to user: Cannot 'detach_volume' instance 6e5c8801-ed84-48a2-b248-e655089e94c3 while it is in vm_state rescued {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:38:34.318747 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0015f554-d8dd-4a3c-8722-df60f8cb3414 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments/4bfecb25-d500-4d15-ab4b-28a230ef874a" status: 409 len: 152 microversion: 2.1 time: 0.152749 Jul 14 20:38:34.318747 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 247/500] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:38:34 2022] DELETE /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments/4bfecb25-d500-4d15-ab4b-28a230ef874a => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 20:38:34.324367 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a7495646-04ac-44eb-8262-cffb4f523d8f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:34.325150 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a7495646-04ac-44eb-8262-cffb4f523d8f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:34.333605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7495646-04ac-44eb-8262-cffb4f523d8f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:34.334058 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7495646-04ac-44eb-8262-cffb4f523d8f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:34.334858 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7495646-04ac-44eb-8262-cffb4f523d8f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:34.335376 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a7495646-04ac-44eb-8262-cffb4f523d8f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:34.412997 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a7495646-04ac-44eb-8262-cffb4f523d8f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "POST /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/action" status: 202 len: 0 microversion: 2.1 time: 0.092336 Jul 14 20:38:34.413619 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 254/501] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:38:34 2022] POST /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:38:34.424386 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:34.425215 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:34.435823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:34.436443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:34.437238 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:34.437980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:34.591762 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:34.600623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c6d4005f-28b1-4392-8263-103e6bcc0383 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1722 microversion: 2.1 time: 0.181928 Jul 14 20:38:34.601271 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 248/502] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:34 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:35.093416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:35.094124 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:35.101172 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:35.101630 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:35.102403 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:35.102849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:35.242762 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:35.251316 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3b8a31c3-6f62-40e1-b640-4c316593c7ac tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1555 microversion: 2.1 time: 0.162518 Jul 14 20:38:35.251911 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 255/503] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:35 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:35.268733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3bfbc790-e105-4c62-a7fb-a51bdf121b5c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:35.269257 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3bfbc790-e105-4c62-a7fb-a51bdf121b5c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:35.271914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:35.277270 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3bfbc790-e105-4c62-a7fb-a51bdf121b5c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:35.277716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3bfbc790-e105-4c62-a7fb-a51bdf121b5c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:35.278490 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3bfbc790-e105-4c62-a7fb-a51bdf121b5c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:35.278921 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3bfbc790-e105-4c62-a7fb-a51bdf121b5c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:35.357544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3bfbc790-e105-4c62-a7fb-a51bdf121b5c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093101 Jul 14 20:38:35.358243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 249/504] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:38:35 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:35.618685 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:35.619252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:35.625920 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:35.626377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:35.627604 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:35.628143 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:35.869308 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:35.879352 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7385d467-8255-4d59-a9de-fbd6934e4e7c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1722 microversion: 2.1 time: 0.264415 Jul 14 20:38:35.880340 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 256/505] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:35 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:36.390220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-1f34f5a7-ef78-404d-af51-b6ceb93911c4 req-6e04ce80-9453-43cd-bba4-460a363f38c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f580e757-6a64-44b4-924f-3710d64601ee", "tag": "384bb2f5-be38-48f0-8c74-d068964e4b64"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:36.403713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-1f34f5a7-ef78-404d-af51-b6ceb93911c4 req-6e04ce80-9453-43cd-bba4-460a363f38c6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:36.404522 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-1f34f5a7-ef78-404d-af51-b6ceb93911c4 req-6e04ce80-9453-43cd-bba4-460a363f38c6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:36.417463 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-1f34f5a7-ef78-404d-af51-b6ceb93911c4 req-6e04ce80-9453-43cd-bba4-460a363f38c6 service nova] Creating event network-changed:384bb2f5-be38-48f0-8c74-d068964e4b64 for instance f580e757-6a64-44b4-924f-3710d64601ee on hv-cinder-79987 Jul 14 20:38:36.423067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-1f34f5a7-ef78-404d-af51-b6ceb93911c4 req-6e04ce80-9453-43cd-bba4-460a363f38c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036326 Jul 14 20:38:36.423666 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 250/506] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:36.900147 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:36.900683 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:36.907161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:36.907612 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:36.908378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:36.908811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:37.041706 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:37.050128 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5fbf0340-35c6-425e-8869-53bb9d01cb9f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1722 microversion: 2.1 time: 0.154400 Jul 14 20:38:37.050787 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 257/507] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:36 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:38.068366 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:38.069057 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:38.075513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:38.076210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:38.077002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:38.077440 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:38.207914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:38.216604 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-361a5c86-b33f-46b6-9c46-9c2812d7ec06 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1722 microversion: 2.1 time: 0.152926 Jul 14 20:38:38.217169 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 251/508] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:38 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:39.234159 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:39.235483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:39.242077 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:39.242617 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:39.243562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:39.244035 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:39.385317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:39.393403 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3c7fe291-080d-4bab-acd9-d8b327a43e24 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1722 microversion: 2.1 time: 0.163299 Jul 14 20:38:39.393905 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 258/509] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:39 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:40.411813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:40.412542 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:40.419143 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:40.419598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:40.420370 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:40.420814 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:40.547038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:40.554811 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f072a012-23f6-41a0-b24b-91de1aa8aa90 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1722 microversion: 2.1 time: 0.147054 Jul 14 20:38:40.555536 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 252/510] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:40 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:38:41.572590 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:41.573203 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:41.579778 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:41.580228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:41.580995 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:41.581435 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:41.715814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:41.724258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4a637225-d444-4d6f-97cf-3e272f9e2178 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1722 microversion: 2.1 time: 0.155496 Jul 14 20:38:41.724824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 259/511] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:41 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:42.741766 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:42.742341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:42.748503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:42.748944 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:42.749699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:42.750731 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:42.877863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:42.885763 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6545318b-9273-40a0-b7d0-a70be512c181 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1728 microversion: 2.1 time: 0.147966 Jul 14 20:38:42.886256 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 253/512] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:38:42 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:42.902342 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8f0d28cb-a7f0-47ec-8591-ed54ccb52c43 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:42.902866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8f0d28cb-a7f0-47ec-8591-ed54ccb52c43 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:42.910016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f0d28cb-a7f0-47ec-8591-ed54ccb52c43 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:42.910525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f0d28cb-a7f0-47ec-8591-ed54ccb52c43 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:42.911358 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f0d28cb-a7f0-47ec-8591-ed54ccb52c43 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:42.911800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8f0d28cb-a7f0-47ec-8591-ed54ccb52c43 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:43.016536 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8f0d28cb-a7f0-47ec-8591-ed54ccb52c43 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117980 Jul 14 20:38:43.017261 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 260/513] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:38:42 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:44.378298 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-32235501-a248-4e7a-97f8-5a81e6cb7ea0 req-e9da9523-f967-40ce-8d74-398b0d260754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5c8801-ed84-48a2-b248-e655089e94c3", "tag": "f924a51a-1824-4be0-9b9b-700305bf906f"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:44.388239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-32235501-a248-4e7a-97f8-5a81e6cb7ea0 req-e9da9523-f967-40ce-8d74-398b0d260754 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:44.388684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-32235501-a248-4e7a-97f8-5a81e6cb7ea0 req-e9da9523-f967-40ce-8d74-398b0d260754 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:44.400116 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-32235501-a248-4e7a-97f8-5a81e6cb7ea0 req-e9da9523-f967-40ce-8d74-398b0d260754 service nova] Creating event network-changed:f924a51a-1824-4be0-9b9b-700305bf906f for instance 6e5c8801-ed84-48a2-b248-e655089e94c3 on hv-cinder-79987 Jul 14 20:38:44.405541 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-32235501-a248-4e7a-97f8-5a81e6cb7ea0 req-e9da9523-f967-40ce-8d74-398b0d260754 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Jul 14 20:38:44.406815 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 254/514] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:46.427533 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-e9560398-044f-4d0a-b2df-2323c9b08890 req-846517dc-7e91-46f3-9694-eae79da44998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5c8801-ed84-48a2-b248-e655089e94c3", "tag": "f924a51a-1824-4be0-9b9b-700305bf906f"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:46.435903 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-e9560398-044f-4d0a-b2df-2323c9b08890 req-846517dc-7e91-46f3-9694-eae79da44998 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:46.436349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-e9560398-044f-4d0a-b2df-2323c9b08890 req-846517dc-7e91-46f3-9694-eae79da44998 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:46.449719 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-e9560398-044f-4d0a-b2df-2323c9b08890 req-846517dc-7e91-46f3-9694-eae79da44998 service nova] Creating event network-changed:f924a51a-1824-4be0-9b9b-700305bf906f for instance 6e5c8801-ed84-48a2-b248-e655089e94c3 on hv-cinder-79987 Jul 14 20:38:46.455056 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-e9560398-044f-4d0a-b2df-2323c9b08890 req-846517dc-7e91-46f3-9694-eae79da44998 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031653 Jul 14 20:38:46.455664 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 261/515] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:53.997940 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-96d8e8d4-1e88-42e7-9450-25d78605e448 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:53.999287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-96d8e8d4-1e88-42e7-9450-25d78605e448 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:54.006885 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-96d8e8d4-1e88-42e7-9450-25d78605e448 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:54.007481 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-96d8e8d4-1e88-42e7-9450-25d78605e448 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:54.008350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-96d8e8d4-1e88-42e7-9450-25d78605e448 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:54.009258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-96d8e8d4-1e88-42e7-9450-25d78605e448 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:54.040713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-96d8e8d4-1e88-42e7-9450-25d78605e448 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments/d04e3791-dc75-4cee-bdee-0646afa05c5a" status: 200 len: 194 microversion: 2.20 time: 0.048346 Jul 14 20:38:54.041314 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 255/516] 10.222.0.52 () {60 vars in 1453 bytes} [Thu Jul 14 20:38:53 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments/d04e3791-dc75-4cee-bdee-0646afa05c5a => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:38:54.111034 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:54.112200 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:54.120626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:54.121291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:54.122267 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:54.123001 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:54.215615 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lazy-loading 'services' on Instance uuid e306d8c2-449e-43db-8e98-53d049726ddc {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:38:54.292574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-35017f4b-927d-4220-9cae-0940112dd3df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments/d04e3791-dc75-4cee-bdee-0646afa05c5a" status: 202 len: 0 microversion: 2.20 time: 0.185523 Jul 14 20:38:54.293410 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 262/517] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Jul 14 20:38:54 2022] DELETE /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments/d04e3791-dc75-4cee-bdee-0646afa05c5a => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:38:54.302292 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bae72ffa-e40d-4087-9976-3fedd3103740 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:54.303254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-bae72ffa-e40d-4087-9976-3fedd3103740 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:54.309487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bae72ffa-e40d-4087-9976-3fedd3103740 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:54.309961 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bae72ffa-e40d-4087-9976-3fedd3103740 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:54.310761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bae72ffa-e40d-4087-9976-3fedd3103740 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:54.311531 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bae72ffa-e40d-4087-9976-3fedd3103740 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:54.351724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-bae72ffa-e40d-4087-9976-3fedd3103740 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053848 Jul 14 20:38:54.352652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 256/518] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 14 20:38:54 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:38:55.367767 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e1255208-cd12-40e1-8402-a548a78fa67f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:55.370030 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e1255208-cd12-40e1-8402-a548a78fa67f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:55.378155 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1255208-cd12-40e1-8402-a548a78fa67f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:55.379007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1255208-cd12-40e1-8402-a548a78fa67f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:55.380028 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1255208-cd12-40e1-8402-a548a78fa67f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:55.380691 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1255208-cd12-40e1-8402-a548a78fa67f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:55.422553 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e1255208-cd12-40e1-8402-a548a78fa67f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061448 Jul 14 20:38:55.442147 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 263/519] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 14 20:38:55 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:38:55.503055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:55.504293 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:55.512795 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:55.513604 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:55.514745 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:55.515425 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:55.550955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:38:55.707445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-032f40a5-9522-4c23-a521-3361e64c4ee3 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 204 len: 0 microversion: 2.20 time: 0.208017 Jul 14 20:38:55.717206 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:55.717821 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:55.720880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 257/520] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 14 20:38:55 2022] DELETE /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 20:38:55.726443 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:55.729516 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:55.730503 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:55.733650 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:56.035649 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:56.041211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:38:56.048727 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:56.050692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:56.052448 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7c9ec419-207b-4bb3-84a0-09df000ec1f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.339514 Jul 14 20:38:56.053301 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 264/521] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:55 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:57.075161 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:57.075877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:57.085578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:57.086039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:57.086825 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:57.087296 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:57.248718 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:57.258712 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:57.260287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:57.261490 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9f6c9a10-65d9-47c1-bb55-b51456bb7e10 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.193114 Jul 14 20:38:57.262230 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 258/522] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:57 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:58.281284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:58.282482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:58.291375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:58.292015 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:58.293089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:58.293348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:58.563996 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:58.590864 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:58.593234 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:58.594690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a94f7448-52e9-45e7-8d66-a41530fcdc84 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1724 microversion: 2.20 time: 0.317634 Jul 14 20:38:58.608749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 265/523] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:58 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:38:59.446025 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-00583350-b55d-44ed-b542-4746b9dba480 req-72085f18-5534-4970-80b7-15e67ef0203d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e306d8c2-449e-43db-8e98-53d049726ddc", "name": "network-vif-deleted", "tag": "1ac0a834-cdf8-45d5-b1de-b010bb6c8485"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:38:59.489766 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-00583350-b55d-44ed-b542-4746b9dba480 req-72085f18-5534-4970-80b7-15e67ef0203d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:59.490225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-00583350-b55d-44ed-b542-4746b9dba480 req-72085f18-5534-4970-80b7-15e67ef0203d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:59.514558 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-00583350-b55d-44ed-b542-4746b9dba480 req-72085f18-5534-4970-80b7-15e67ef0203d service nova] Creating event network-vif-deleted:1ac0a834-cdf8-45d5-b1de-b010bb6c8485 for instance e306d8c2-449e-43db-8e98-53d049726ddc on hv-cinder-79987 Jul 14 20:38:59.552881 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-00583350-b55d-44ed-b542-4746b9dba480 req-72085f18-5534-4970-80b7-15e67ef0203d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115110 Jul 14 20:38:59.553519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 259/524] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:38:59.614884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:38:59.622337 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:38:59.656634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:59.664178 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:59.665271 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:59.665731 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:59.744255 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:38:59.745030 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:38:59.745805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lazy-loading 'fault' on Instance uuid e306d8c2-449e-43db-8e98-53d049726ddc {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:38:59.805377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:59.815053 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:59.817039 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:38:59.818226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ad11f0e2-53b2-4e50-b002-f9a4245eb849 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 200 len: 1372 microversion: 2.20 time: 0.208314 Jul 14 20:38:59.819042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 266/525] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:38:59 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:39:00.838529 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:00.839478 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:00.845863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:00.846958 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:00.847755 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:00.848390 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:00.863412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] HTTP exception thrown: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Request method failure captured: Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc HTTP/1.1 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3hs4lfnds1lVIH6oNqG9OJgfeQyRkR8aVEQuZLkik3sZgAKztWX0F9CkXYY_xJDX7dajxlvYUGF8otuO6a6FEBUlSmOn8t1HsVbP6gJRsxSgLVpr1OFg-f9Wx92X4dRhxYKuxqmBkmfxXybEq0M74JsveJ5aGwXyvpnV8p-HD4_08 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:39:00.865295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8d67813ac3a41d6a7b7ae8ac9629d71", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 5cf43634335a428093ee30c2dd99187b Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:39:00.866663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'e306d8c2-449e-43db-8e98-53d049726ddc'} Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:39:00.867455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:39:00.869273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:00.872181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Returning 404 to user: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:39:00.872181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-89842514-a2d8-45f7-b1fb-30b9a0266908 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 404 len: 111 microversion: 2.20 time: 0.033267 Jul 14 20:39:00.872181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 260/526] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:00 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:39:00.878400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c7532b9b-1f6c-4c86-a691-6375ab3e141c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '.version_select at 0x7fafb19bcf70>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:00.898385 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c7532b9b-1f6c-4c86-a691-6375ab3e141c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978963873" status: 204 len: 0 microversion: 2.20 time: 0.024500 Jul 14 20:39:00.899756 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 267/527] 10.222.0.52 () {60 vars in 1261 bytes} [Thu Jul 14 20:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978963873 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 20:39:02.567082 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-26f5c5f3-6e19-4068-b995-c4d3d3eb2f3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'create', calling method: .version_select at 0x7fafb1ac9550>, body: {"keypair": {"name": "tempest-keypair-868786529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHanHlap0hjxQogN15uKe7M8D+IIzSwcWdXco3CT47Bk1yNNYdzSrE0Kw6K9VUsTpkQNObupiNSYv7dzVhY1eAvVcFmEKSlyaWGVWw814sH7iUsyW1ymdZObhlq7+h008Q=="}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:02.615586 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-26f5c5f3-6e19-4068-b995-c4d3d3eb2f3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:39:02.635799 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-26f5c5f3-6e19-4068-b995-c4d3d3eb2f3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for user 5cf43634335a428093ee30c2dd99187b and project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:39:02.705695 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-26f5c5f3-6e19-4068-b995-c4d3d3eb2f3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.143849 Jul 14 20:39:02.707117 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 261/528] 10.222.0.52 () {62 vars in 1199 bytes} [Thu Jul 14 20:39:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 20:39:04.579942 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1058673896", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc4df55f-56f1-4441-a13c-56b6d6bdcde5"}], "security_groups": [{"name": "tempest-securitygroup--1615238611"}], "key_name": "tempest-keypair-868786529", "user_data": "}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:04.587497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:04.688634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] validate_networks() for [('fc4df55f-56f1-4441-a13c-56b6d6bdcde5', None, None, None, None, None)] {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:39:05.137213 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:39:05.138061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:39:05.138686 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:39:05.139627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:39:05.140205 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:39:05.153670 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:05.154145 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:05.154927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:05.155386 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:05.181242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:39:05.187183 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Getting quotas for user 5cf43634335a428093ee30c2dd99187b and project d8d67813ac3a41d6a7b7ae8ac9629d71. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:39:05.206338 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:39:05.209211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:39:05.274004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-bf2b3dc8-77a5-4ba6-8c98-19a9a4822fb0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.699397 Jul 14 20:39:05.277269 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 268/529] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Jul 14 20:39:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 20:39:05.288527 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-82d930da-b354-4fc7-ae83-ff42752d2e87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:05.290737 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-82d930da-b354-4fc7-ae83-ff42752d2e87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:05.304325 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:05.410822 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-82d930da-b354-4fc7-ae83-ff42752d2e87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:05.433870 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-82d930da-b354-4fc7-ae83-ff42752d2e87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:05.435670 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-82d930da-b354-4fc7-ae83-ff42752d2e87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:05.436940 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-82d930da-b354-4fc7-ae83-ff42752d2e87 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1281 microversion: 2.20 time: 0.153056 Jul 14 20:39:05.438675 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 262/530] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:05 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:39:06.467471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:06.470415 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:06.479881 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:06.480487 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:06.481378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:06.482065 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:06.565524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:06.582310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:06.585872 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:06.587827 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ceddae4c-7282-4019-a431-ddb0ffd999b9 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1333 microversion: 2.20 time: 0.134521 Jul 14 20:39:06.588643 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 269/531] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:06 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1333 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:07.610505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:07.612097 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:07.620346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:07.621109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:07.622171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:07.622767 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:07.632634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:07.785140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:07.794508 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:07.796359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:07.797877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-059203c6-eea3-4dec-8181-a2394ea85a4c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1339 microversion: 2.20 time: 0.193131 Jul 14 20:39:07.798636 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 263/532] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:07 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:08.816109 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:08.817361 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:08.825060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:08.825790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:08.827272 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:08.829654 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:09.074860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:09.089615 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:09.097386 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:09.099007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c04082bc-46cd-4daf-ad3a-1ff602e28be4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1407 microversion: 2.20 time: 0.287010 Jul 14 20:39:09.101373 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 270/533] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:08 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:09.455445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-cd2aa6db-6642-454b-b9d1-040d53f8607b req-ff64e7f0-dd9c-4a1f-83f7-35bfdedf70b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea90cac-431b-48d8-8171-944bd150754f", "tag": "a450ed13-0148-4da1-9b7d-201016068164"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:09.474202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-cd2aa6db-6642-454b-b9d1-040d53f8607b req-ff64e7f0-dd9c-4a1f-83f7-35bfdedf70b0 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:09.474654 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-cd2aa6db-6642-454b-b9d1-040d53f8607b req-ff64e7f0-dd9c-4a1f-83f7-35bfdedf70b0 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:09.508068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-cd2aa6db-6642-454b-b9d1-040d53f8607b req-ff64e7f0-dd9c-4a1f-83f7-35bfdedf70b0 service nova] Creating event network-changed:a450ed13-0148-4da1-9b7d-201016068164 for instance 8ea90cac-431b-48d8-8171-944bd150754f on hv-cinder-79987 Jul 14 20:39:09.515048 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-cd2aa6db-6642-454b-b9d1-040d53f8607b req-ff64e7f0-dd9c-4a1f-83f7-35bfdedf70b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065305 Jul 14 20:39:09.522843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 264/534] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:10.127044 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:10.128300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:10.148985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:10.149445 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:10.150253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:10.150693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:10.363163 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:10.381529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:10.383807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:10.390455 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1c5b5525-851e-445a-90e9-2e215f101760 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1407 microversion: 2.20 time: 0.270792 Jul 14 20:39:10.401915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 271/535] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:10 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:11.409664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:11.411078 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:11.419994 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:11.420727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:11.421839 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:11.422557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:11.661352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:11.686456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:11.691811 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:11.694702 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cbb376ee-3f56-4e89-a982-50faf73ca722 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1407 microversion: 2.20 time: 0.289675 Jul 14 20:39:11.706203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 265/536] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:11 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:12.484241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f2924eed-77a2-4fb2-94d5-9be1d5a69463 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:12.491024 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f2924eed-77a2-4fb2-94d5-9be1d5a69463 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:12.503119 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2924eed-77a2-4fb2-94d5-9be1d5a69463 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:12.504288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2924eed-77a2-4fb2-94d5-9be1d5a69463 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:12.510030 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2924eed-77a2-4fb2-94d5-9be1d5a69463 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:12.511499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2924eed-77a2-4fb2-94d5-9be1d5a69463 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:12.567930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f2924eed-77a2-4fb2-94d5-9be1d5a69463 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/ips" status: 200 len: 148 microversion: 2.1 time: 0.090362 Jul 14 20:39:12.579983 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 272/537] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:39:12 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/ips => generated 148 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:12.718394 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:12.720075 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:12.741406 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:12.742254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:12.748834 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:12.754443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:12.964285 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:12.972576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:12.974084 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:12.975229 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0e52b41b-0cc3-4f35-b3ba-e4aa4108bfae tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1407 microversion: 2.20 time: 0.264632 Jul 14 20:39:12.975787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 266/538] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:12 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:13.930468 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-ac830bb4-00d9-460b-8414-d8c8ab07c47d req-f3528ff1-22be-4229-b07a-aff7884e2457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea90cac-431b-48d8-8171-944bd150754f", "name": "network-vif-plugged", "status": "completed", "tag": "a450ed13-0148-4da1-9b7d-201016068164"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:13.945040 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-ac830bb4-00d9-460b-8414-d8c8ab07c47d req-f3528ff1-22be-4229-b07a-aff7884e2457 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:13.946236 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-ac830bb4-00d9-460b-8414-d8c8ab07c47d req-f3528ff1-22be-4229-b07a-aff7884e2457 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:13.971347 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-ac830bb4-00d9-460b-8414-d8c8ab07c47d req-f3528ff1-22be-4229-b07a-aff7884e2457 service nova] Creating event network-vif-plugged:a450ed13-0148-4da1-9b7d-201016068164 for instance 8ea90cac-431b-48d8-8171-944bd150754f on hv-cinder-79987 Jul 14 20:39:13.979933 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-ac830bb4-00d9-460b-8414-d8c8ab07c47d req-f3528ff1-22be-4229-b07a-aff7884e2457 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055046 Jul 14 20:39:13.981999 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 273/539] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:13.999083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:14.000009 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:14.014049 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:14.015096 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:14.016602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:14.017209 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:14.092206 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b9444ee7-b410-4be3-85ef-15d320f3b184 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5962f53-7e7a-457f-ae35-8f1147d9139e"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:14.105019 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b9444ee7-b410-4be3-85ef-15d320f3b184 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:14.114660 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9444ee7-b410-4be3-85ef-15d320f3b184 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:14.122385 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9444ee7-b410-4be3-85ef-15d320f3b184 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:14.123601 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9444ee7-b410-4be3-85ef-15d320f3b184 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:14.124247 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9444ee7-b410-4be3-85ef-15d320f3b184 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:14.269400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:14.280979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:14.283660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:14.287656 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e56b5621-a9f7-4df5-bd9b-545834c09bec tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1407 microversion: 2.20 time: 0.295034 Jul 14 20:39:14.289010 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 267/540] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:13 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:14.596546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b9444ee7-b410-4be3-85ef-15d320f3b184 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515713 Jul 14 20:39:14.598311 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 274/541] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:39:14 2022] POST /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:15.334337 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:15.341364 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:15.380203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:15.383922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:15.385255 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:15.385872 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:15.427612 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=6 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:15.600534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:15.617563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:15.619688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:15.621462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f8f45654-7b45-4466-91ab-394dea3026e8 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1407 microversion: 2.20 time: 0.308723 Jul 14 20:39:15.622544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 268/542] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:15 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:39:16.443261 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:16.444112 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=6 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:16.449110 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b28fd352-d38e-4bc0-bf53-0486551e28f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Action: 'create', calling method: .version_select at 0x7fafb1a65e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-348375845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmp219hlOt8dWkVvZARJ+H35Yj0ccWNdZlKFpxCw8yTx82cwnTj2slNduyu2yqy63RnUNIOYQXVJbMTX0iYbw4LNIPSIASZ0Ayp9OpuWL6zxpFb9G+GMjSGW1DlHPnPGg=="}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:16.465152 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-b28fd352-d38e-4bc0-bf53-0486551e28f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Getting quotas for project 2df2b1715762427cb824e381a83bdad1. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:39:16.470022 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-b28fd352-d38e-4bc0-bf53-0486551e28f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Getting quotas for user 75744cbe26cb4635af3db596f3c235b5 and project 2df2b1715762427cb824e381a83bdad1. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:39:16.503654 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b28fd352-d38e-4bc0-bf53-0486551e28f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061774 Jul 14 20:39:16.504463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 275/543] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:39:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:16.559345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-783322902", "imageRef": "4f38fabf-00fa-422d-ac3e-bb80f5841368", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-348375845", "networks": [{"uuid": "c65ab1d4-eb21-4009-a66c-ca67606d42ed"}]}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:16.614990 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] validate_networks() for [('c65ab1d4-eb21-4009-a66c-ca67606d42ed', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:39:16.664881 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:16.666453 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:16.679173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:16.679714 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:16.680539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:16.680979 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:16.930108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:16.941586 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:16.943220 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:16.944482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f45cae84-0f4b-41b3-92e0-35460e60567e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1598 microversion: 2.20 time: 0.295340 Jul 14 20:39:16.945108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 276/544] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:39:16 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1598 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:39:16.971619 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7feb6032-04fa-43c5-8f6e-05898ac52279 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:16.972576 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7feb6032-04fa-43c5-8f6e-05898ac52279 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:16.980074 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7feb6032-04fa-43c5-8f6e-05898ac52279 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:16.980534 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7feb6032-04fa-43c5-8f6e-05898ac52279 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:16.981320 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7feb6032-04fa-43c5-8f6e-05898ac52279 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:16.981759 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7feb6032-04fa-43c5-8f6e-05898ac52279 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:17.107886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7feb6032-04fa-43c5-8f6e-05898ac52279 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143817 Jul 14 20:39:17.108583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 277/545] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Jul 14 20:39:16 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:39:17.213962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:39:17.214383 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:39:17.214882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:39:17.215300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:39:17.215716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:39:17.226149 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:17.226598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:17.227659 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:17.228096 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:17.249731 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Getting quotas for project 2df2b1715762427cb824e381a83bdad1. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:39:17.254221 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Getting quotas for user 75744cbe26cb4635af3db596f3c235b5 and project 2df2b1715762427cb824e381a83bdad1. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:39:17.267389 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:39:17.269674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f38fabf-00fa-422d-ac3e-bb80f5841368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:39:17.318451 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a916e3c7-a621-4adf-80d3-e38d8bd2b354 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765604 Jul 14 20:39:17.323855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 269/546] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:39:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:39:17.330963 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-290c3c10-541f-4af4-86b4-e8b8d8a9fea5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:17.331605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-290c3c10-541f-4af4-86b4-e8b8d8a9fea5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:17.396776 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-290c3c10-541f-4af4-86b4-e8b8d8a9fea5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:17.405310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-290c3c10-541f-4af4-86b4-e8b8d8a9fea5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1257 microversion: 2.1 time: 0.079980 Jul 14 20:39:17.406229 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 278/547] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:17 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:18.380743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-6b21f595-784a-4f89-8a0a-9ebbabb03d0f req-4c2ab38e-c75b-4696-aa96-6fa0987b8b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea90cac-431b-48d8-8171-944bd150754f", "tag": "a450ed13-0148-4da1-9b7d-201016068164"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:18.394409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-6b21f595-784a-4f89-8a0a-9ebbabb03d0f req-4c2ab38e-c75b-4696-aa96-6fa0987b8b53 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:18.395598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-6b21f595-784a-4f89-8a0a-9ebbabb03d0f req-4c2ab38e-c75b-4696-aa96-6fa0987b8b53 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:18.427414 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:18.428039 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:18.432777 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-6b21f595-784a-4f89-8a0a-9ebbabb03d0f req-4c2ab38e-c75b-4696-aa96-6fa0987b8b53 service nova] Creating event network-changed:a450ed13-0148-4da1-9b7d-201016068164 for instance 8ea90cac-431b-48d8-8171-944bd150754f on hv-cinder-79987 Jul 14 20:39:18.446710 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-6b21f595-784a-4f89-8a0a-9ebbabb03d0f req-4c2ab38e-c75b-4696-aa96-6fa0987b8b53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069677 Jul 14 20:39:18.447053 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:18.447812 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:18.448648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:18.449093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:18.451744 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 270/548] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:18.571750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:18.583012 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6bf83e1e-8f4f-4c69-8a28-c4c4a0434427 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1317 microversion: 2.1 time: 0.161573 Jul 14 20:39:18.586494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 279/549] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:18 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:19.622754 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:19.627594 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:19.656049 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:19.658036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:19.660401 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:19.660860 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:19.871634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:19.889908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d99b174e-8e76-4fbe-b604-a9e4f5e22026 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.286061 Jul 14 20:39:19.891790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 271/550] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:19 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:20.814477 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-3818b20f-14e8-439a-8bc6-502a24353f41 req-6f4fbafd-33b0-458b-8345-48aae92ede3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152", "tag": "987b5585-aa48-407d-914f-a635c3962008"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:20.853639 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-3818b20f-14e8-439a-8bc6-502a24353f41 req-6f4fbafd-33b0-458b-8345-48aae92ede3f service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:20.854103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-3818b20f-14e8-439a-8bc6-502a24353f41 req-6f4fbafd-33b0-458b-8345-48aae92ede3f service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:20.878645 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-3818b20f-14e8-439a-8bc6-502a24353f41 req-6f4fbafd-33b0-458b-8345-48aae92ede3f service nova] Creating event network-changed:987b5585-aa48-407d-914f-a635c3962008 for instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 on hv-cinder-79987 Jul 14 20:39:20.884464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-3818b20f-14e8-439a-8bc6-502a24353f41 req-6f4fbafd-33b0-458b-8345-48aae92ede3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074985 Jul 14 20:39:20.885609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 280/551] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:20.910544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:20.912485 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:20.931063 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:20.931919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:20.933263 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:20.934193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:21.128872 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:21.138242 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f2520128-18ff-460f-b3f3-14c67623e70f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.233618 Jul 14 20:39:21.139574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 272/552] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:20 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:22.160187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:22.160887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:22.168711 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:22.169319 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:22.170146 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:22.170597 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:22.358436 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:22.360772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:22.362040 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:22.373253 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:22.374254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:22.375999 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c8f23439-093b-425f-8e16-cd83386f0735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.222590 Jul 14 20:39:22.376319 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:22.376609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 281/553] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:22 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:22.386462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:22.492455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lazy-loading 'services' on Instance uuid 6e5c8801-ed84-48a2-b248-e655089e94c3 {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:39:22.698503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ffd27e5c-dbf1-4c32-8b07-ea1fe56cae86 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments/4bfecb25-d500-4d15-ab4b-28a230ef874a" status: 202 len: 0 microversion: 2.1 time: 0.344443 Jul 14 20:39:22.699424 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 273/554] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:39:22 2022] DELETE /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments/4bfecb25-d500-4d15-ab4b-28a230ef874a => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:39:22.715540 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-69bebfe6-f608-48ba-9aea-d3c491486062 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:22.717551 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-69bebfe6-f608-48ba-9aea-d3c491486062 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:22.729000 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69bebfe6-f608-48ba-9aea-d3c491486062 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:22.729527 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69bebfe6-f608-48ba-9aea-d3c491486062 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:22.730494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69bebfe6-f608-48ba-9aea-d3c491486062 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:22.731132 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69bebfe6-f608-48ba-9aea-d3c491486062 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:22.769378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-69bebfe6-f608-48ba-9aea-d3c491486062 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062755 Jul 14 20:39:22.770485 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 282/555] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:22 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:23.393587 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:23.394600 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:23.403771 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:23.404605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:23.406903 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:23.409493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:23.620628 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:23.641670 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-870a0e6a-3f35-4ff7-aa3b-570537b06be7 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.251127 Jul 14 20:39:23.643399 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 274/556] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:23 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:23.792026 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-99612f7b-b711-4e99-a928-1fd8d3ed8faa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:23.793945 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-99612f7b-b711-4e99-a928-1fd8d3ed8faa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:23.806745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99612f7b-b711-4e99-a928-1fd8d3ed8faa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:23.807594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99612f7b-b711-4e99-a928-1fd8d3ed8faa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:23.809246 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99612f7b-b711-4e99-a928-1fd8d3ed8faa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:23.810084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99612f7b-b711-4e99-a928-1fd8d3ed8faa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:23.870326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-99612f7b-b711-4e99-a928-1fd8d3ed8faa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086689 Jul 14 20:39:23.871675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 283/557] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:23 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:24.669304 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:24.672059 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:24.683357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:24.684494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:24.686144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:24.687269 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:24.871655 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:24.881148 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ca3c92a0-b113-4969-a4f2-5a70e7443f1e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.218607 Jul 14 20:39:24.882343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 275/558] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:24 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:24.887573 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f2077e6d-dded-40cb-92dc-54d9faf8e6fa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:24.891252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f2077e6d-dded-40cb-92dc-54d9faf8e6fa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:24.903451 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2077e6d-dded-40cb-92dc-54d9faf8e6fa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:24.904395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2077e6d-dded-40cb-92dc-54d9faf8e6fa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:24.905455 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2077e6d-dded-40cb-92dc-54d9faf8e6fa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:24.906143 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2077e6d-dded-40cb-92dc-54d9faf8e6fa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:24.946189 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f2077e6d-dded-40cb-92dc-54d9faf8e6fa tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067064 Jul 14 20:39:24.949911 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 284/559] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:24 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:25.905374 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:25.906553 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:25.913782 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:25.914230 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:25.915237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:25.915873 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:25.958875 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d0b6c863-6503-477d-b5ab-8af9916795fc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:25.959862 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d0b6c863-6503-477d-b5ab-8af9916795fc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:25.967094 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d0b6c863-6503-477d-b5ab-8af9916795fc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:25.967556 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d0b6c863-6503-477d-b5ab-8af9916795fc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:25.969007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d0b6c863-6503-477d-b5ab-8af9916795fc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:25.969464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d0b6c863-6503-477d-b5ab-8af9916795fc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:25.996961 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:26.032480 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d0b6c863-6503-477d-b5ab-8af9916795fc tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071883 Jul 14 20:39:26.040508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 285/560] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:25 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:26.121962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:26.129967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ad8dd16a-8029-44e5-97da-2a822c419503 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.228537 Jul 14 20:39:26.131667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 276/561] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:25 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:27.045628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-051b35e2-e314-4228-80e6-a541c6be15a5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:27.047074 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-051b35e2-e314-4228-80e6-a541c6be15a5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:27.054699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-051b35e2-e314-4228-80e6-a541c6be15a5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:27.055172 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-051b35e2-e314-4228-80e6-a541c6be15a5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:27.055940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-051b35e2-e314-4228-80e6-a541c6be15a5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:27.056372 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-051b35e2-e314-4228-80e6-a541c6be15a5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:27.091448 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-051b35e2-e314-4228-80e6-a541c6be15a5 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050422 Jul 14 20:39:27.092008 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 286/562] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:27 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:27.147482 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:27.148123 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:27.154900 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:27.155534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:27.156806 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:27.157243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:27.235814 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:27.261077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=6 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:27.297395 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:27.305162 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9e69254b-5c2b-4a59-8e8d-81c9df70224b tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.161709 Jul 14 20:39:27.305733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 277/563] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:27 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:28.103270 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-19179b43-7aaf-460c-9151-b9c9d8ce5a58 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:28.104108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-19179b43-7aaf-460c-9151-b9c9d8ce5a58 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:28.105983 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=6 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:28.112652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19179b43-7aaf-460c-9151-b9c9d8ce5a58 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:28.113104 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19179b43-7aaf-460c-9151-b9c9d8ce5a58 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:28.113892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19179b43-7aaf-460c-9151-b9c9d8ce5a58 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:28.114356 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-19179b43-7aaf-460c-9151-b9c9d8ce5a58 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:28.145604 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-19179b43-7aaf-460c-9151-b9c9d8ce5a58 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046100 Jul 14 20:39:28.146904 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 287/564] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:28 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:28.321836 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:28.322485 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:28.329998 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:28.330445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:28.331270 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:28.331704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:28.464138 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:28.472323 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-74c221e9-a2f7-48e8-bc6f-5abb2c4b5454 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.154370 Jul 14 20:39:28.472892 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 278/565] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:28 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:28.976487 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5962f53-7e7a-457f-ae35-8f1147d9139e"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:28.977561 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:28.984674 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:28.985127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:28.985909 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:28.986346 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.071436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Invalid volume: volume a5962f53-7e7a-457f-ae35-8f1147d9139e is already attached to instances: f580e757-6a64-44b4-924f-3710d64601ee Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: POST /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments HTTP/1.1 Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 74 Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:39:29.073476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {"volumeAttachment": {"volumeId": "a5962f53-7e7a-457f-ae35-8f1147d9139e"}} Jul 14 20:39:29.075307 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Invalid volume: volume a5962f53-7e7a-457f-ae35-8f1147d9139e is already attached to instances: f580e757-6a64-44b4-924f-3710d64601ee Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'server_id': 'f580e757-6a64-44b4-924f-3710d64601ee', 'body': {'volumeAttachment': {'volumeId': 'a5962f53-7e7a-457f-ae35-8f1147d9139e'}}} Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a5962f53-7e7a-457f-ae35-8f1147d9139e is already attached to instances: f580e757-6a64-44b4-924f-3710d64601ee Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:29.076078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a5962f53-7e7a-457f-ae35-8f1147d9139e is already attached to instances: f580e757-6a64-44b4-924f-3710d64601ee Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:29.077296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a5962f53-7e7a-457f-ae35-8f1147d9139e is already attached to instances: f580e757-6a64-44b4-924f-3710d64601ee Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 400 to user: Invalid volume: volume a5962f53-7e7a-457f-ae35-8f1147d9139e is already attached to instances: f580e757-6a64-44b4-924f-3710d64601ee {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e1909e95-2d1b-4692-8b8e-9baa04393b65 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102580 Jul 14 20:39:29.079688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 288/566] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:39:28 2022] POST /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:39:29.138308 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:29.138893 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:29.145950 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.146758 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.147740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.148180 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.159930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a28baf81-923d-4acc-827a-e9465341dd7b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:29.161192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a28baf81-923d-4acc-827a-e9465341dd7b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:29.172751 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a28baf81-923d-4acc-827a-e9465341dd7b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.173309 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a28baf81-923d-4acc-827a-e9465341dd7b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.173985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a28baf81-923d-4acc-827a-e9465341dd7b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.174419 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a28baf81-923d-4acc-827a-e9465341dd7b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.208616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a28baf81-923d-4acc-827a-e9465341dd7b tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053305 Jul 14 20:39:29.209520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 289/567] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:29 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:29.249287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lazy-loading 'services' on Instance uuid f580e757-6a64-44b4-924f-3710d64601ee {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:39:29.328188 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b4daa51e-cc36-473f-aca7-68671e43cf60 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments/a5962f53-7e7a-457f-ae35-8f1147d9139e" status: 202 len: 0 microversion: 2.1 time: 0.192980 Jul 14 20:39:29.328919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 279/568] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:39:29 2022] DELETE /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments/a5962f53-7e7a-457f-ae35-8f1147d9139e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:39:29.337319 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-626a0ad4-569b-4761-aa34-c152ba7c6b93 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:29.338266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-626a0ad4-569b-4761-aa34-c152ba7c6b93 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:29.344648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-626a0ad4-569b-4761-aa34-c152ba7c6b93 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.345090 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-626a0ad4-569b-4761-aa34-c152ba7c6b93 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.346081 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-626a0ad4-569b-4761-aa34-c152ba7c6b93 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.346520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-626a0ad4-569b-4761-aa34-c152ba7c6b93 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.381102 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-626a0ad4-569b-4761-aa34-c152ba7c6b93 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047713 Jul 14 20:39:29.381884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 290/569] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:29 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:29.489576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:29.490275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:29.497080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.497533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.498305 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:29.498748 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:29.526308 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:29.668686 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:29.677226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a02b3716-1946-4bf1-98fe-130627c34b8a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.191792 Jul 14 20:39:29.677796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 280/570] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:29 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:30.220424 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a9ce9577-f5e2-4c86-87e8-bad17e8a5cef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:30.221257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a9ce9577-f5e2-4c86-87e8-bad17e8a5cef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:30.227740 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9ce9577-f5e2-4c86-87e8-bad17e8a5cef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.228190 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9ce9577-f5e2-4c86-87e8-bad17e8a5cef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.228946 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9ce9577-f5e2-4c86-87e8-bad17e8a5cef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.229382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9ce9577-f5e2-4c86-87e8-bad17e8a5cef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.257949 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a9ce9577-f5e2-4c86-87e8-bad17e8a5cef tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041559 Jul 14 20:39:30.258508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 291/571] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:30 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 20:39:30.330098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:30.330623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:30.337057 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.337507 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.338268 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.338736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.363030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:39:30.393703 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dc2e6c26-f6d5-4464-b682-3863d63ef1cc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:30.394792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dc2e6c26-f6d5-4464-b682-3863d63ef1cc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:30.401607 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc2e6c26-f6d5-4464-b682-3863d63ef1cc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.402329 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc2e6c26-f6d5-4464-b682-3863d63ef1cc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.403234 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc2e6c26-f6d5-4464-b682-3863d63ef1cc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.403736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc2e6c26-f6d5-4464-b682-3863d63ef1cc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.434724 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dc2e6c26-f6d5-4464-b682-3863d63ef1cc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Jul 14 20:39:30.435496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 292/572] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:30 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:30.440479 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9fbf616a-9a76-4f6f-aaa6-da3555be108f tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 204 len: 0 microversion: 2.1 time: 0.114492 Jul 14 20:39:30.441117 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 281/573] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:39:30 2022] DELETE /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:39:30.449209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:30.449820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:30.456546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.456998 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.457764 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.458212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.585051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:30.592458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2fc05dda-03ef-48c2-b328-d027806973b0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1688 microversion: 2.1 time: 0.146945 Jul 14 20:39:30.593068 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 293/574] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:30 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:30.694999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:30.695698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:30.701774 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.702227 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.703029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:30.703468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:30.838441 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:30.846414 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-64a3ce79-422c-42cc-b3a0-ffbfe90e8f9d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.155846 Jul 14 20:39:30.846983 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 282/575] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:30 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:31.448181 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8004ce20-9997-46df-a827-1142781bc0ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:31.449022 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8004ce20-9997-46df-a827-1142781bc0ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:31.457163 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8004ce20-9997-46df-a827-1142781bc0ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:31.457615 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8004ce20-9997-46df-a827-1142781bc0ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:31.458401 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8004ce20-9997-46df-a827-1142781bc0ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:31.458865 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8004ce20-9997-46df-a827-1142781bc0ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:31.491777 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8004ce20-9997-46df-a827-1142781bc0ae tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047969 Jul 14 20:39:31.492340 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 294/576] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:31 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:31.610240 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:31.610852 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:31.617398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:31.617858 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:31.618633 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:31.619116 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:31.751709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:31.759265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-380200ca-d31f-4252-9c95-4a747c0248b6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1688 microversion: 2.1 time: 0.153542 Jul 14 20:39:31.759830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 283/577] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:31 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:31.863288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:31.863901 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:31.870065 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:31.870712 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:31.871524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:31.871958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:32.006859 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:32.014648 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-01f33f98-788e-4a97-95cb-ed30ce15b3f2 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.155123 Jul 14 20:39:32.015308 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 295/578] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:31 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:32.504530 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e2be073b-17bd-49ab-9f70-afd6dc4aab7c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:32.506364 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e2be073b-17bd-49ab-9f70-afd6dc4aab7c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:32.514137 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e2be073b-17bd-49ab-9f70-afd6dc4aab7c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:32.514592 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e2be073b-17bd-49ab-9f70-afd6dc4aab7c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:32.515501 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e2be073b-17bd-49ab-9f70-afd6dc4aab7c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:32.516978 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e2be073b-17bd-49ab-9f70-afd6dc4aab7c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:32.552215 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e2be073b-17bd-49ab-9f70-afd6dc4aab7c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052300 Jul 14 20:39:32.552951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 284/579] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:32 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:32.777273 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:32.777929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:32.785514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:32.785966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:32.786769 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:32.787289 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:32.921815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:32.929477 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4cdc40c1-4719-42b5-9b56-ab7eca15a3af tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1688 microversion: 2.1 time: 0.156264 Jul 14 20:39:32.930049 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 296/580] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:32 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:33.033712 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:33.034272 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:33.041276 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:33.041725 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:33.042513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:33.043030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:33.186088 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:33.193736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fa47af12-50d3-4f30-b937-47dbfbd67471 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.165081 Jul 14 20:39:33.194302 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 285/581] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:33 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:33.565604 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b4bdda55-cb48-491b-9fe3-ab57bd90891a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:33.566709 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b4bdda55-cb48-491b-9fe3-ab57bd90891a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:33.573115 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4bdda55-cb48-491b-9fe3-ab57bd90891a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:33.573563 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4bdda55-cb48-491b-9fe3-ab57bd90891a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:33.574340 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4bdda55-cb48-491b-9fe3-ab57bd90891a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:33.574775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4bdda55-cb48-491b-9fe3-ab57bd90891a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:33.607164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b4bdda55-cb48-491b-9fe3-ab57bd90891a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Jul 14 20:39:33.607745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 297/582] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:33 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:33.946875 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:33.947539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:33.953886 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:33.954339 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:33.955187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:33.955629 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:34.051705 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-637a7096-e34e-4e7b-89c4-b2c0701db024 req-b8727bac-51af-42eb-921c-cacfaf506327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152", "name": "network-vif-plugged", "status": "completed", "tag": "987b5585-aa48-407d-914f-a635c3962008"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:34.061517 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-637a7096-e34e-4e7b-89c4-b2c0701db024 req-b8727bac-51af-42eb-921c-cacfaf506327 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:34.062067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-637a7096-e34e-4e7b-89c4-b2c0701db024 req-b8727bac-51af-42eb-921c-cacfaf506327 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:34.075348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-637a7096-e34e-4e7b-89c4-b2c0701db024 req-b8727bac-51af-42eb-921c-cacfaf506327 service nova] Creating event network-vif-plugged:987b5585-aa48-407d-914f-a635c3962008 for instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 on hv-cinder-79987 Jul 14 20:39:34.081903 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-637a7096-e34e-4e7b-89c4-b2c0701db024 req-b8727bac-51af-42eb-921c-cacfaf506327 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Jul 14 20:39:34.082745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 298/583] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:34.124248 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:34.137620 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6bc57bad-cdea-451c-a9b6-1aa31865ef2e tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1688 microversion: 2.1 time: 0.194719 Jul 14 20:39:34.138211 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 286/584] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:33 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:34.211119 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:34.211936 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:34.219528 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:34.219975 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:34.220780 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:34.221225 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:34.401436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:34.411992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-535eed94-7aa8-4ca3-aa87-6caf739ea764 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.205456 Jul 14 20:39:34.413031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 299/585] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:34 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:34.621050 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8b0c4976-02ed-480a-9da6-d937a45eaa10 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:34.622752 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8b0c4976-02ed-480a-9da6-d937a45eaa10 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:34.632067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b0c4976-02ed-480a-9da6-d937a45eaa10 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:34.632502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b0c4976-02ed-480a-9da6-d937a45eaa10 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:34.633315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b0c4976-02ed-480a-9da6-d937a45eaa10 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:34.637663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b0c4976-02ed-480a-9da6-d937a45eaa10 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:34.691754 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8b0c4976-02ed-480a-9da6-d937a45eaa10 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075279 Jul 14 20:39:34.693337 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 287/586] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:34 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:35.159111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:35.160141 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:35.163893 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:35.173860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.174719 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.176212 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.177197 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.363252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:35.373679 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f62ea227-d46f-4cad-a7ea-2743e688684a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1688 microversion: 2.1 time: 0.221434 Jul 14 20:39:35.375038 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 300/587] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:35 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:35.434695 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:35.435816 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:35.440503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:35.450103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.450618 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.451592 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.452086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.639407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:35.648986 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e8304cab-3b2b-4a1c-8788-d77202cdcfb3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1357 microversion: 2.1 time: 0.221992 Jul 14 20:39:35.649562 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 288/588] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:35 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:35.705892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d443bf4b-ada3-4e69-9d4c-d26d99950152 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:35.709931 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d443bf4b-ada3-4e69-9d4c-d26d99950152 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:35.714016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d443bf4b-ada3-4e69-9d4c-d26d99950152 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.714016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d443bf4b-ada3-4e69-9d4c-d26d99950152 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.714726 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d443bf4b-ada3-4e69-9d4c-d26d99950152 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.715367 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d443bf4b-ada3-4e69-9d4c-d26d99950152 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.748016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d443bf4b-ada3-4e69-9d4c-d26d99950152 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046726 Jul 14 20:39:35.748637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 301/589] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:39:35 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 20:39:35.773378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-0dcbd60d-380a-4d2c-9a78-5902cde815b5 req-f414bd4a-2b84-450b-a8e6-241f728b1214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5c8801-ed84-48a2-b248-e655089e94c3", "name": "network-vif-deleted", "tag": "f924a51a-1824-4be0-9b9b-700305bf906f"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:35.783045 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-0dcbd60d-380a-4d2c-9a78-5902cde815b5 req-f414bd4a-2b84-450b-a8e6-241f728b1214 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.783505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-0dcbd60d-380a-4d2c-9a78-5902cde815b5 req-f414bd4a-2b84-450b-a8e6-241f728b1214 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.805002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-0dcbd60d-380a-4d2c-9a78-5902cde815b5 req-f414bd4a-2b84-450b-a8e6-241f728b1214 service nova] Creating event network-vif-deleted:f924a51a-1824-4be0-9b9b-700305bf906f for instance 6e5c8801-ed84-48a2-b248-e655089e94c3 on hv-cinder-79987 Jul 14 20:39:35.813300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-0dcbd60d-380a-4d2c-9a78-5902cde815b5 req-f414bd4a-2b84-450b-a8e6-241f728b1214 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043035 Jul 14 20:39:35.813921 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 289/590] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:35.836055 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:35.836581 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:35.847779 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.848548 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.849560 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.850259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.878645 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:39:35.881998 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:35.971917 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c62c932c-aa80-4f85-b7b3-96826d892550 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 204 len: 0 microversion: 2.1 time: 0.139475 Jul 14 20:39:35.972757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 302/591] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:39:35 2022] DELETE /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:39:35.986476 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:35.987792 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:35.997818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.998265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:35.999072 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:35.999543 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:36.167880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:36.175952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0027be62-b145-4f80-8cc6-5fad4c4372b8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1679 microversion: 2.1 time: 0.197929 Jul 14 20:39:36.176708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 290/592] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:35 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:36.393734 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:36.394552 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:36.401968 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:36.402736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:36.403750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:36.404391 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:36.494550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:36.503850 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c0bc5f49-6552-490b-b3f5-35edc5d1a5d6 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1331 microversion: 2.1 time: 0.115238 Jul 14 20:39:36.504818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 303/593] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:36 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:36.666550 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:36.671766 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:36.677843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:36.678763 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:36.680439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:36.681615 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:36.846046 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:36.864825 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-83fe8eea-4880-4c9d-8735-604f88303efb tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1547 microversion: 2.1 time: 0.202935 Jul 14 20:39:36.865782 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 291/594] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:36 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1547 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:36.889900 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:36.890539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:36.897590 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:36.898045 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:36.898824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:36.899298 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.053046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:37.061062 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ce74bba1-6938-4d5b-ad51-5c2776c64475 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1547 microversion: 2.1 time: 0.175386 Jul 14 20:39:37.061641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 304/595] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:36 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:37.076610 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:37.080245 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:37.081002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Searching by: {'deleted': False, 'project_id': '2df2b1715762427cb824e381a83bdad1'} {{(pid=124371) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 20:39:37.087991 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.088432 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.089251 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.089676 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.189643 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.multi_cell_list [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124371) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 20:39:37.194424 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:37.195216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:37.201491 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.201954 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.203414 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.203863 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.286819 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1919638e-205c-45f7-9660-d594b4ae4315 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213881 Jul 14 20:39:37.287343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 292/596] 10.222.0.52 () {58 vars in 1124 bytes} [Thu Jul 14 20:39:37 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:37.297779 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:37.298388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:37.304396 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.304846 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.305616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.306060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.461887 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:37.472092 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-627e665b-2ea0-4e6f-b38c-56d8cbd034e5 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1547 microversion: 2.1 time: 0.177731 Jul 14 20:39:37.472880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 293/597] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:37 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:37.521972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:37.522578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:37.532556 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.533510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.535257 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.536088 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.586014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:37.591566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:37.592023 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:37.592477 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lazy-loading 'fault' on Instance uuid 6e5c8801-ed84-48a2-b248-e655089e94c3 {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:39:37.594094 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-677cf041-97eb-4073-ad5e-279aaedd044a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1679 microversion: 2.1 time: 0.403788 Jul 14 20:39:37.604118 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 305/598] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:37 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1679 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:37.634850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:37.643472 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1b65ba04-6f0d-45c7-a057-87f3454e69ce tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 200 len: 1336 microversion: 2.1 time: 0.125594 Jul 14 20:39:37.644058 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 294/599] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:37 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:38.612410 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:38.613031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:38.619960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:38.620403 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:38.621182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:38.621679 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:38.661422 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:38.662128 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 6e5c8801-ed84-48a2-b248-e655089e94c3] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:38.669336 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:38.669786 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:38.670565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:38.671700 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:38.686994 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] HTTP exception thrown: Instance 6e5c8801-ed84-48a2-b248-e655089e94c3 could not be found. Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Request method failure captured: Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 HTTP/1.1 Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3kAdV8bnoIbkfi3zXPBwAE-Yhbyqz8yki4CrvyyCbj9qY6qD9JQ8NtTQx2D1a3lJ6Ytd_IJmAAVrbrIUoqOcPSQpsgj1kCVNQo1wrmQ7oP6MGyR9evbAASgPVUvR79k9mFnfITuGEcMvh9oql-AzkgZkHKstC8gQMMiRaotA1vIfw Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:39:38.688708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cceb4db55bba4bd099104acdcb6d2762", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 765c911957bd4ca68dd520fc4fbba1c9 Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 6e5c8801-ed84-48a2-b248-e655089e94c3 could not be found. Jul 14 20:39:38.690005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '6e5c8801-ed84-48a2-b248-e655089e94c3'} Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5c8801-ed84-48a2-b248-e655089e94c3 could not be found. Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:39:38.690775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5c8801-ed84-48a2-b248-e655089e94c3 could not be found. Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5c8801-ed84-48a2-b248-e655089e94c3 could not be found. Jul 14 20:39:38.692548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:38.693723 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Returning 404 to user: Instance 6e5c8801-ed84-48a2-b248-e655089e94c3 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:39:38.693723 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c3a91ae7-0288-4d6a-bfbd-8a10ec577600 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3" status: 404 len: 111 microversion: 2.1 time: 0.033365 Jul 14 20:39:38.697560 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 295/600] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:38 2022] GET /compute/v2.1/servers/6e5c8801-ed84-48a2-b248-e655089e94c3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:39:38.701214 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-758c3bad-a4f5-49cb-92c8-e4e4a728a100 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '.version_select at 0x7fafb1af5280>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:38.724717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-758c3bad-a4f5-49cb-92c8-e4e4a728a100 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049057207" status: 202 len: 0 microversion: 2.1 time: 0.027719 Jul 14 20:39:38.725485 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 296/601] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 14 20:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049057207 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:39:38.795093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:38.803147 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-feb54317-662e-43f1-b6ee-183ad6de1e37 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1679 microversion: 2.1 time: 0.195239 Jul 14 20:39:38.803729 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 306/602] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:38 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:39.071673 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5ecca9b5-ef0b-43b6-98cb-60e45943c62a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90288118-791d-4e85-ab79-449065769cb4"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:39.072806 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5ecca9b5-ef0b-43b6-98cb-60e45943c62a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:39.081019 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ecca9b5-ef0b-43b6-98cb-60e45943c62a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:39.081733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ecca9b5-ef0b-43b6-98cb-60e45943c62a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:39.082524 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ecca9b5-ef0b-43b6-98cb-60e45943c62a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:39.083197 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5ecca9b5-ef0b-43b6-98cb-60e45943c62a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:39.087816 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:39.555647 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5ecca9b5-ef0b-43b6-98cb-60e45943c62a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487705 Jul 14 20:39:39.558030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 297/603] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:39:39 2022] POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:39.821800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:39.822512 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:39.840763 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:39.841632 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:39.843632 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:39.844411 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:39.997131 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:40.005241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6c78d383-08c5-4cd5-8247-485730e906e7 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 200 len: 1611 microversion: 2.1 time: 0.187720 Jul 14 20:39:40.015508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 307/604] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:39 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 1611 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:40.154789 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-66cb930d-c20c-4446-a252-6fe8cfa23b85 req-be44ea28-9d33-4be3-881b-513443f935ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f580e757-6a64-44b4-924f-3710d64601ee", "name": "network-vif-deleted", "tag": "384bb2f5-be38-48f0-8c74-d068964e4b64"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:40.164437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-66cb930d-c20c-4446-a252-6fe8cfa23b85 req-be44ea28-9d33-4be3-881b-513443f935ba service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:40.165008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-66cb930d-c20c-4446-a252-6fe8cfa23b85 req-be44ea28-9d33-4be3-881b-513443f935ba service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:40.184554 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-66cb930d-c20c-4446-a252-6fe8cfa23b85 req-be44ea28-9d33-4be3-881b-513443f935ba service nova] Creating event network-vif-deleted:384bb2f5-be38-48f0-8c74-d068964e4b64 for instance f580e757-6a64-44b4-924f-3710d64601ee on hv-cinder-79987 Jul 14 20:39:40.189836 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-66cb930d-c20c-4446-a252-6fe8cfa23b85 req-be44ea28-9d33-4be3-881b-513443f935ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040567 Jul 14 20:39:40.190796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 298/605] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:41.028598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:41.029602 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:41.037986 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:41.038439 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:41.039263 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:41.039705 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:41.054667 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee HTTP/1.1 Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:39:41.056409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:39:41.057886 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'f580e757-6a64-44b4-924f-3710d64601ee'} Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:39:41.058824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:39:41.060061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:41.061125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:39:41.061125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-df7fcc25-3b84-4027-b71e-6a1e603ff304 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 404 len: 111 microversion: 2.1 time: 0.035793 Jul 14 20:39:41.061125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 308/606] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:41 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:39:41.071819 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6074b9f9-499b-4f92-a233-706774fcb6e4 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '.version_select at 0x7fafb19785e0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:41.090287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6074b9f9-499b-4f92-a233-706774fcb6e4 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310678301" status: 202 len: 0 microversion: 2.1 time: 0.023381 Jul 14 20:39:41.091009 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 299/607] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Jul 14 20:39:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310678301 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:39:41.721226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-08802470-cb61-486d-9c08-bf621e392c8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: .version_select at 0x7fafb19bc700>, body: {"keypair": {"name": "tempest-keypair-1752125852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkiC0uuu0Kz5vKSSA+jfZPUd04wGy/KNos2g8IDn4djZCgN6Kpjvd/R2AxCIJABODlI8uAiAbKHyE5TPDHgQzbCSgqgSgB0LBuHh9kLUCm3I3BsbuuC2xgobEw0qiUKFw=="}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:41.735447 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-08802470-cb61-486d-9c08-bf621e392c8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:39:41.739371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-08802470-cb61-486d-9c08-bf621e392c8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:39:41.768511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-08802470-cb61-486d-9c08-bf621e392c8e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051505 Jul 14 20:39:41.769265 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 309/608] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:39:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:41.960398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:41.961020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:41.967526 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:41.968551 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:41.969333 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:41.969772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:41.995623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:39:42.081466 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-dde5714a-0933-471d-b3d6-8491ed58c4e8 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 204 len: 0 microversion: 2.1 time: 0.124717 Jul 14 20:39:42.082065 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 300/609] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:39:41 2022] DELETE /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 20:39:42.090702 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:42.091345 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:42.098360 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:42.098815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:42.099650 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:42.100551 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:42.539883 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:42.548771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-80aa8e68-ea6d-40c1-9666-74a5e9e07991 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1508 microversion: 2.1 time: 0.462416 Jul 14 20:39:42.549354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 310/610] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:42 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:43.349244 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-957077667", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "946dd351-5829-4dff-b5e5-6e232f299044"}], "security_groups": [{"name": "tempest-securitygroup--664268709"}], "key_name": "tempest-keypair-1752125852", "user_data": "}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:43.454534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] validate_networks() for [('946dd351-5829-4dff-b5e5-6e232f299044', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:39:43.571874 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:43.573166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:43.585424 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:43.586160 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:43.587602 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:43.588478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:43.812651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:43.820357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-16fa6a39-0752-4fd9-bc73-cffbbfd69867 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1508 microversion: 2.1 time: 0.256013 Jul 14 20:39:43.820930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 311/611] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:43 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:43.905603 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:39:43.906031 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:39:43.906498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:39:43.906905 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:39:43.907338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:39:43.916125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:43.916574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:43.918002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:43.918002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:43.935403 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:39:43.939852 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Getting quotas for user 16c6975c73954487a1f15649693b1d8a and project 40baf66113cf4fb186ddd5e954a9b7a4. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:39:43.950743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:39:43.953691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:39:44.000243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d2a630c1-b1d5-4c16-9848-990ade931b68 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.655719 Jul 14 20:39:44.000893 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 301/612] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:39:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:39:44.011089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-000c00f2-4a29-4865-9244-91e7a58d0147 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:44.011692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-000c00f2-4a29-4865-9244-91e7a58d0147 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:44.068331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-000c00f2-4a29-4865-9244-91e7a58d0147 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:44.075463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-000c00f2-4a29-4865-9244-91e7a58d0147 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1241 microversion: 2.1 time: 0.068174 Jul 14 20:39:44.079108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 312/613] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:44 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:44.484056 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:44.484681 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:44.494834 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:44.495366 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:44.496244 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:44.496738 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:44.531950 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:39:44.604638 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-77b438df-47c2-4e9c-bfa8-5eae146714f1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 204 len: 0 microversion: 2.1 time: 0.126117 Jul 14 20:39:44.605216 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 302/614] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:39:44 2022] DELETE /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:39:44.615557 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:44.616934 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:44.636293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:44.639881 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:44.640788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:44.641180 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:44.810308 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:44.817892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-593529a8-c8e6-4ca7-be88-67c1a5bb8e52 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1579 microversion: 2.1 time: 0.207686 Jul 14 20:39:44.818463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 313/615] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:44 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1579 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:44.838244 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:44.838967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:44.845975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:44.846419 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:44.847220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:44.847650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:44.976937 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:44.984296 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7c6fb390-2201-4ec5-b823-f90002dad3eb tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1508 microversion: 2.1 time: 0.150372 Jul 14 20:39:44.984859 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 303/616] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:44 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:45.092254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:45.092965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:45.099050 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:45.099497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:45.100259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:45.100687 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:45.162135 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:45.170118 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2c8ca3f7-21dc-4020-bf3b-e507c2ca31ef tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1237 microversion: 2.1 time: 0.081732 Jul 14 20:39:45.170822 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 314/617] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:45 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:45.837098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:45.837745 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:45.845057 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:45.845513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:45.846292 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:45.846729 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:45.985494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:45.993086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2dbb2106-36f4-4787-abd7-cf72c6956a79 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1579 microversion: 2.1 time: 0.160089 Jul 14 20:39:45.993652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 304/618] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:45 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:46.000550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:46.001150 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:46.007789 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:46.008233 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:46.009000 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:46.009434 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:46.188793 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:46.189321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:46.195670 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:46.196129 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:46.196917 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:46.197550 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:46.204335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:46.211975 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c344b0cb-299d-4400-a58e-4b53314c197a tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1508 microversion: 2.1 time: 0.215151 Jul 14 20:39:46.212549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 315/619] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:45 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:46.292588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:46.301006 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-61d52993-5a39-4993-b0ea-1a0047afe769 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1293 microversion: 2.1 time: 0.116966 Jul 14 20:39:46.304870 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 305/620] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:46 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:46.556255 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-d1d58214-0dab-4931-8196-13f4b895b240 req-ba9ac800-0238-4f21-9900-bd0c4f196c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476db6db-4757-4a95-a7b8-7fab0e3f6a68", "name": "network-vif-deleted", "tag": "1f90d544-e4b7-4775-8f93-61ce62d596b4"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:46.580425 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-d1d58214-0dab-4931-8196-13f4b895b240 req-ba9ac800-0238-4f21-9900-bd0c4f196c9a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:46.580910 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-d1d58214-0dab-4931-8196-13f4b895b240 req-ba9ac800-0238-4f21-9900-bd0c4f196c9a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:46.593676 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-d1d58214-0dab-4931-8196-13f4b895b240 req-ba9ac800-0238-4f21-9900-bd0c4f196c9a service nova] Creating event network-vif-deleted:1f90d544-e4b7-4775-8f93-61ce62d596b4 for instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 on hv-cinder-79987 Jul 14 20:39:46.598763 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-d1d58214-0dab-4931-8196-13f4b895b240 req-ba9ac800-0238-4f21-9900-bd0c4f196c9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046221 Jul 14 20:39:46.599409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 316/621] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:47.009359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:47.009971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:47.016987 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:47.017442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:47.018226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:47.018670 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:47.151178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:47.159226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-783c0f9f-fe50-4c00-a4d8-365f229ed5b7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1579 microversion: 2.1 time: 0.153559 Jul 14 20:39:47.159797 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 306/622] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:47 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:47.230969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:47.232073 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:47.239366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:47.239920 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:47.240966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:47.241501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:47.320064 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:47.320863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:47.329900 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:47.334593 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:47.336258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:47.338138 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:47.338375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:47.347101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b4c4a88d-bd1e-4115-8cbd-191386ddfad4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 200 len: 1293 microversion: 2.1 time: 0.121080 Jul 14 20:39:47.347608 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 317/623] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:47 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:47.427086 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:47.437302 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-dea59f6f-1a8a-40f9-a517-614d19c0eb9d tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1311 microversion: 2.1 time: 0.122468 Jul 14 20:39:47.438577 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 307/624] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:47 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:48.177896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:48.178757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:48.187558 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.188516 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.189519 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.190026 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.235969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:48.236734 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:48.244316 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.244849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.248043 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.249297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.315170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:48.324550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b958b165-7ba7-4792-a03b-a9a31e7af1a2 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1511 microversion: 2.1 time: 0.151400 Jul 14 20:39:48.325236 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 318/625] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:48 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:48.365605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:48.366547 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 476db6db-4757-4a95-a7b8-7fab0e3f6a68] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:48.373276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.373884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.374884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.375626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.421710 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] HTTP exception thrown: Instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 could not be found. Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Request method failure captured: Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 HTTP/1.1 Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3kAdV8bnoIbkfi3zXPBwAE-Yhbyqz8yki4CrvyyCbj9qY6qD9JQ8NtTQx2D1a3lJ6Ytd_IJmAAVrbrIUoqOcPSQpsgj1kCVNQo1wrmQ7oP6MGyR9evbAASgPVUvR79k9mFnfITuGEcMvh9oql-AzkgZkHKstC8gQMMiRaotA1vIfw Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:39:48.424867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cceb4db55bba4bd099104acdcb6d2762", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 765c911957bd4ca68dd520fc4fbba1c9 Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 could not be found. Jul 14 20:39:48.426290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '476db6db-4757-4a95-a7b8-7fab0e3f6a68'} Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 could not be found. Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:39:48.427253 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 could not be found. Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 could not be found. Jul 14 20:39:48.428428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:48.429633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Returning 404 to user: Instance 476db6db-4757-4a95-a7b8-7fab0e3f6a68 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:39:48.429633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0f1dec9a-1575-468d-886d-7cc5957f609d tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68" status: 404 len: 111 microversion: 2.1 time: 0.064794 Jul 14 20:39:48.429633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 319/626] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:48 2022] GET /compute/v2.1/servers/476db6db-4757-4a95-a7b8-7fab0e3f6a68 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:39:48.437841 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:48.438369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:48.445969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.447010 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.447892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.448551 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.481911 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:39:48.502706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:48.511628 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8572555c-ad7e-48d4-b86f-03f712cf570e tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1593 microversion: 2.1 time: 0.279953 Jul 14 20:39:48.515783 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 308/627] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:48 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1593 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:48.528997 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:48.529614 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:48.546089 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.546474 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.547299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.547734 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.555872 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:48.669417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c64aed48-8553-4dbe-a7c2-9d7ba82176df tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 204 len: 0 microversion: 2.1 time: 0.236351 Jul 14 20:39:48.671292 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 320/628] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:39:48 2022] DELETE /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:39:48.681680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-60e6a824-eb84-4fab-b721-bb811001b87e req-7dda7724-f0b8-4423-a087-771fcdf91ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f144a8-c1b4-424d-80f0-da744bd56947", "name": "network-vif-deleted", "tag": "6a85c30d-87e7-49c7-9ba4-5135c2402791"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:48.691406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-60e6a824-eb84-4fab-b721-bb811001b87e req-7dda7724-f0b8-4423-a087-771fcdf91ef6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.692279 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-60e6a824-eb84-4fab-b721-bb811001b87e req-7dda7724-f0b8-4423-a087-771fcdf91ef6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.711200 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-60e6a824-eb84-4fab-b721-bb811001b87e req-7dda7724-f0b8-4423-a087-771fcdf91ef6 service nova] Creating event network-vif-deleted:6a85c30d-87e7-49c7-9ba4-5135c2402791 for instance b3f144a8-c1b4-424d-80f0-da744bd56947 on hv-cinder-79987 Jul 14 20:39:48.722738 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-60e6a824-eb84-4fab-b721-bb811001b87e req-7dda7724-f0b8-4423-a087-771fcdf91ef6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049556 Jul 14 20:39:48.723525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 321/629] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:48.732616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:48.733867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:48.741290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.742099 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.743165 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:48.744087 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:48.949616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:48.964946 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6bce5c5b-02ea-4f93-8ba6-dc3a0b31b42e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.448009 Jul 14 20:39:48.965831 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 309/630] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:48 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:49.063966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:49.076289 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cdb37cdc-cc40-483c-892e-0a586c01b1be tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.351197 Jul 14 20:39:49.077726 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 322/631] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:48 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:49.342653 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:49.343455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:49.353965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:49.360894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:49.362114 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:49.362772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:49.492337 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:49.502770 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f1dd983b-6da1-4629-872f-cfa7b04532c4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1226 microversion: 2.1 time: 0.164933 Jul 14 20:39:49.503812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 310/632] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:49 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:49.694652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-bc46a1dd-4b37-4732-83a7-4f9eef88c56c req-59df7793-e954-479e-81ef-ca5d6eefed29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846e301f-53f5-484c-9871-46e7472509ba", "tag": "3311ac61-3d71-4bc4-a82e-b644a5accd11"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:49.706466 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-bc46a1dd-4b37-4732-83a7-4f9eef88c56c req-59df7793-e954-479e-81ef-ca5d6eefed29 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:49.707474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-bc46a1dd-4b37-4732-83a7-4f9eef88c56c req-59df7793-e954-479e-81ef-ca5d6eefed29 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:49.728431 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-bc46a1dd-4b37-4732-83a7-4f9eef88c56c req-59df7793-e954-479e-81ef-ca5d6eefed29 service nova] Creating event network-changed:3311ac61-3d71-4bc4-a82e-b644a5accd11 for instance 846e301f-53f5-484c-9871-46e7472509ba on hv-cinder-79987 Jul 14 20:39:49.734141 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-bc46a1dd-4b37-4732-83a7-4f9eef88c56c req-59df7793-e954-479e-81ef-ca5d6eefed29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048288 Jul 14 20:39:49.734916 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 323/633] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:49.982872 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:49.983606 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:49.990984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:49.991518 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:49.992366 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:49.993044 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:50.008685 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:50.095149 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:50.095881 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:50.102446 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:50.103188 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:50.103976 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:50.104416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:50.132253 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:50.141281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f5a3c557-8133-4f8b-9d47-4b5ee694179e tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.162258 Jul 14 20:39:50.142271 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 311/634] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:49 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:50.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:50.253080 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f5a3a598-50e6-43e5-9e0a-318609ae1c1c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.162730 Jul 14 20:39:50.253779 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 324/635] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:50 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:50.520218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:50.520803 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:50.527225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:50.527674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:50.528436 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:50.528869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:50.601976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:50.610502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-24acafa7-46ee-4830-87d0-688a43e31d9a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1226 microversion: 2.1 time: 0.094310 Jul 14 20:39:50.611248 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 312/636] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:50 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:50.778166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-88866b84-e742-4f8c-a19a-ed766f43b6ce req-8f55480a-ed31-4889-984a-ce02a04974ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152", "tag": "987b5585-aa48-407d-914f-a635c3962008"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:50.792414 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-88866b84-e742-4f8c-a19a-ed766f43b6ce req-8f55480a-ed31-4889-984a-ce02a04974ad service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:50.792929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-88866b84-e742-4f8c-a19a-ed766f43b6ce req-8f55480a-ed31-4889-984a-ce02a04974ad service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:50.809203 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-88866b84-e742-4f8c-a19a-ed766f43b6ce req-8f55480a-ed31-4889-984a-ce02a04974ad service nova] Creating event network-changed:987b5585-aa48-407d-914f-a635c3962008 for instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 on hv-cinder-79987 Jul 14 20:39:50.816784 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-88866b84-e742-4f8c-a19a-ed766f43b6ce req-8f55480a-ed31-4889-984a-ce02a04974ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053094 Jul 14 20:39:50.817399 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 325/637] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:51.159036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:51.159644 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:51.165912 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.166357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.167174 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.167606 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.273101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:51.273788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:51.284498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.287257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.288241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.288840 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.346505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:51.354470 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d717c6aa-2b2f-48c7-b587-9a14028bb744 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.199397 Jul 14 20:39:51.367048 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 313/638] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:51 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:51.468551 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:51.479320 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5c9d3753-2369-4231-8eb1-0bb4da5011a4 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.212692 Jul 14 20:39:51.488592 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 326/639] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:51 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:51.617714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1282505549"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:51.618256 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:51.625757 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.626202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.626999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.627498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.627651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:51.628195 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:51.635383 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.639680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.640659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:51.641108 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:51.712849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:51.721023 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8899e776-45eb-470c-8416-a6e8ff41a389 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 200 len: 1226 microversion: 2.1 time: 0.097461 Jul 14 20:39:51.721817 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 327/640] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:51 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:51.796692 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.network.security_group_api [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Adding security group 36c58622-2413-47b8-b171-0623dd201cb5 to port 987b5585-aa48-407d-914f-a635c3962008 Jul 14 20:39:52.224907 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5cce2ecb-a79e-4df3-885b-99a3572245c9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/action" status: 202 len: 0 microversion: 2.1 time: 0.611098 Jul 14 20:39:52.225979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 314/641] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:39:51 2022] POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:39:52.237188 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:52.238531 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:52.250841 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:52.253109 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:52.255123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:52.255745 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:52.260017 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-c93b650e-b87d-4a8c-96bd-fe74e4fbd84e req-3cceefcd-13c3-4039-bc70-8b9d45be3c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152", "tag": "987b5585-aa48-407d-914f-a635c3962008"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:52.273947 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-c93b650e-b87d-4a8c-96bd-fe74e4fbd84e req-3cceefcd-13c3-4039-bc70-8b9d45be3c3d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:52.284016 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-c93b650e-b87d-4a8c-96bd-fe74e4fbd84e req-3cceefcd-13c3-4039-bc70-8b9d45be3c3d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:52.299215 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-c93b650e-b87d-4a8c-96bd-fe74e4fbd84e req-3cceefcd-13c3-4039-bc70-8b9d45be3c3d service nova] Creating event network-changed:987b5585-aa48-407d-914f-a635c3962008 for instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 on hv-cinder-79987 Jul 14 20:39:52.307362 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-c93b650e-b87d-4a8c-96bd-fe74e4fbd84e req-3cceefcd-13c3-4039-bc70-8b9d45be3c3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051855 Jul 14 20:39:52.308685 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 315/642] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:39:52.501141 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:52.502514 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:52.515738 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:52.517560 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:52.521284 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:52.522052 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:52.768374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:52.778456 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d9f356ff-5a79-4237-a0bd-6aa6639ee098 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1640 microversion: 2.1 time: 0.545890 Jul 14 20:39:52.779416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 328/643] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:52 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1640 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:52.797002 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:52.797989 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:52.814476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:52.815393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:52.816499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:52.817162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:53.207033 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:53.222084 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8be165e2-0d3b-4b36-b74e-a878390eeea8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.852727 Jul 14 20:39:53.224127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 316/644] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:52 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:53.233146 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:53.234022 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:53.243726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:53.244459 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:53.245412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:53.245843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:53.265681 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] HTTP exception thrown: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Request method failure captured: Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 HTTP/1.1 Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H5PbOvH48jKWxZzxYWsNCAJyVHGhuC6J0YrVco_RN4MH1n6NHHT5UIczVQKBr7AWSpciOPPWm7jeXUiJNfNpC-qGdTQ8GdCKP3oQARzxPkTyCOPJSriYf734botd6ibjl8cWFOHk9MtLQeXNDCriAI1VTtarrBK3ZlC5BXj12ZXNqw Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:39:53.267895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83a29cbfb7484b76a9131a3b81832c62", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-TestVolumeBootPattern-955624271 Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 6502e3ffa3b84333a00ea5f712767d61 Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:39:53.269534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'b3f144a8-c1b4-424d-80f0-da744bd56947'} Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:39:53.270716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:39:53.272127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:39:53.273329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Returning 404 to user: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:39:53.273329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d92aa7d2-8858-426d-9369-458552d8f844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 404 len: 111 microversion: 2.1 time: 0.046148 Jul 14 20:39:53.287317 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 317/645] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:53 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:39:53.399492 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:53.408413 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-fa7001a3-1e8d-4462-9210-5fa019a468a0 tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1521 microversion: 2.1 time: 0.627470 Jul 14 20:39:53.408997 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 329/646] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:52 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1521 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:53.438208 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1084679878", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1335986240", "security_groups": [{"name": "tempest-secgroup-smoke-2107497457"}], "block_device_mapping_v2": [{"uuid": "089928b1-849a-4c7f-a05a-a973d701a06f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c361a5af-edf6-43ec-86b8-8164b7612499"}]}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:53.603842 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] validate_networks() for [('c361a5af-edf6-43ec-86b8-8164b7612499', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:39:53.926105 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=4 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:53.946152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=6 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:54.035035 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:39:54.035454 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:39:54.035919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:39:54.036322 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:39:54.036726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:39:54.045953 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.046396 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.047217 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.047653 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.059178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:54.067189 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:39:54.072409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for user 6502e3ffa3b84333a00ea5f712767d61 and project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:39:54.133836 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:39:54.136015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='089928b1-849a-4c7f-a05a-a973d701a06f',volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:39:54.239633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:54.240324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:54.242568 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=6 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:39:54.249229 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.249883 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.250819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.251438 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.289315 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f59130d0-63a4-4081-9463-106f39e7ecb3 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.855335 Jul 14 20:39:54.289988 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 318/647] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:39:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:39:54.300995 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3cc99a30-47ed-4d49-9393-cba7debaf6fa tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:54.301714 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3cc99a30-47ed-4d49-9393-cba7debaf6fa tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:54.380737 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3cc99a30-47ed-4d49-9393-cba7debaf6fa tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:54.392064 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3cc99a30-47ed-4d49-9393-cba7debaf6fa tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1095 microversion: 2.1 time: 0.094738 Jul 14 20:39:54.393395 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 319/648] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:54 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:54.400667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-63039582-0c84-49af-8492-3d1ff8ab31ff req-27a082da-ff69-4b09-b3a5-7ef056e84d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e709bc-663e-4241-bdc4-350e7c4d6ce4", "name": "network-vif-deleted", "tag": "33ce41a8-cfae-480a-8e36-a527518059f8"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:54.410847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-63039582-0c84-49af-8492-3d1ff8ab31ff req-27a082da-ff69-4b09-b3a5-7ef056e84d83 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.411432 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-63039582-0c84-49af-8492-3d1ff8ab31ff req-27a082da-ff69-4b09-b3a5-7ef056e84d83 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.424668 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-63039582-0c84-49af-8492-3d1ff8ab31ff req-27a082da-ff69-4b09-b3a5-7ef056e84d83 service nova] Creating event network-vif-deleted:33ce41a8-cfae-480a-8e36-a527518059f8 for instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 on hv-cinder-79987 Jul 14 20:39:54.429599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-63039582-0c84-49af-8492-3d1ff8ab31ff req-27a082da-ff69-4b09-b3a5-7ef056e84d83 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Jul 14 20:39:54.430201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 320/649] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:54.435446 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:54.436194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:54.442516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.442991 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.443984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.444426 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.458994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:54.468438 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f1aebed6-460a-4cbe-b211-a1ae4b6b9432 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.232659 Jul 14 20:39:54.469755 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 330/650] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:54 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:54.480348 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:54.481506 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:54.481971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lazy-loading 'fault' on Instance uuid 44e709bc-663e-4241-bdc4-350e7c4d6ce4 {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:39:54.527387 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c911957bd4ca68dd520fc4fbba1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb4db55bba4bd099104acdcb6d2762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:54.535600 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b101f184-3e54-46d0-8bc4-7b563d82adbf tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 200 len: 1312 microversion: 2.1 time: 0.104295 Jul 14 20:39:54.536176 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 321/651] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:54 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:55.411028 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:55.411939 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:55.420978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:55.421628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:55.423025 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:55.423805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:55.486991 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:55.487736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:55.494832 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:55.495398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:55.496257 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:55.496760 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:55.512145 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:55.523499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-118a4205-af6b-420e-9b8b-03c23dd025cc tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1201 microversion: 2.1 time: 0.115988 Jul 14 20:39:55.524851 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 331/652] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:55 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1201 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:55.553043 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:55.553652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] [instance: 44e709bc-663e-4241-bdc4-350e7c4d6ce4] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:55.560011 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:55.560464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:55.561793 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:55.562240 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:55.577792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] HTTP exception thrown: Instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 could not be found. Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Request method failure captured: Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 HTTP/1.1 Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3kAdV8bnoIbkfi3zXPBwAE-Yhbyqz8yki4CrvyyCbj9qY6qD9JQ8NtTQx2D1a3lJ6Ytd_IJmAAVrbrIUoqOcPSQpsgj1kCVNQo1wrmQ7oP6MGyR9evbAASgPVUvR79k9mFnfITuGEcMvh9oql-AzkgZkHKstC8gQMMiRaotA1vIfw Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:39:55.579610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cceb4db55bba4bd099104acdcb6d2762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cceb4db55bba4bd099104acdcb6d2762", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: cceb4db55bba4bd099104acdcb6d2762 Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1249507495 Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 765c911957bd4ca68dd520fc4fbba1c9 Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1249507495-project Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 could not be found. Jul 14 20:39:55.581223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '44e709bc-663e-4241-bdc4-350e7c4d6ce4'} Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 could not be found. Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:39:55.582042 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 could not be found. Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 could not be found. Jul 14 20:39:55.583465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:39:55.585249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] Returning 404 to user: Instance 44e709bc-663e-4241-bdc4-350e7c4d6ce4 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:39:55.585249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b9069ea9-7017-43d7-a226-b45eb096fe3c tempest-ServerRescueNegativeTestJSON-1249507495 tempest-ServerRescueNegativeTestJSON-1249507495-project] 10.222.0.52 "GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4" status: 404 len: 111 microversion: 2.1 time: 0.032222 Jul 14 20:39:55.585249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 332/653] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:55 2022] GET /compute/v2.1/servers/44e709bc-663e-4241-bdc4-350e7c4d6ce4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:39:55.777321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:55.787019 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3a27b980-aa30-425e-a5b3-3e9000f78848 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.304764 Jul 14 20:39:55.787899 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 322/654] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:55 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:56.543667 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:56.545682 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:56.552486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:56.553350 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:56.554330 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:56.555257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:56.798217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:56.808353 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-350b128c-9d4f-4923-a50c-efac3a0fbb26 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.269693 Jul 14 20:39:56.808568 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:56.809227 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:56.818922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 333/655] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:56 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:56.827196 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:56.828226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:56.829953 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:56.831098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:57.080142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:57.088145 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-67fe5b40-6b29-435b-b3d0-29d61fcfeb09 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.287104 Jul 14 20:39:57.088717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 323/656] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:56 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:39:57.444319 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-5af1eddc-fd96-4cbe-ad05-3e95af0055be req-e704ad22-7557-461e-be7b-cadb3d53b4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8165ae1-4719-48d2-9171-41ee878766c2", "tag": "9d7cb7f5-d312-41e5-b399-d59c90177499"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:57.462866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-5af1eddc-fd96-4cbe-ad05-3e95af0055be req-e704ad22-7557-461e-be7b-cadb3d53b4f6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:57.463254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-5af1eddc-fd96-4cbe-ad05-3e95af0055be req-e704ad22-7557-461e-be7b-cadb3d53b4f6 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:57.490678 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-5af1eddc-fd96-4cbe-ad05-3e95af0055be req-e704ad22-7557-461e-be7b-cadb3d53b4f6 service nova] Creating event network-changed:9d7cb7f5-d312-41e5-b399-d59c90177499 for instance d8165ae1-4719-48d2-9171-41ee878766c2 on hv-cinder-79987 Jul 14 20:39:57.496039 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-5af1eddc-fd96-4cbe-ad05-3e95af0055be req-e704ad22-7557-461e-be7b-cadb3d53b4f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055717 Jul 14 20:39:57.497156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 334/657] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:57.827509 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:57.829369 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:57.839394 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:57.840613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:57.841631 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:57.842770 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:58.092124 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:58.104914 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c29a5736-3fa9-4396-a5f0-afd8c77a7f46 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.283035 Jul 14 20:39:58.108411 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:58.109229 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 324/658] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:57 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:58.110632 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:58.124162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:58.124959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:58.126550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:58.127919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:58.211480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-58a8edcc-0653-4b26-bf19-a53415e315f8 req-0e5ab826-7fe4-47e3-9e8e-8024259cce05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846e301f-53f5-484c-9871-46e7472509ba", "name": "network-vif-plugged", "status": "completed", "tag": "3311ac61-3d71-4bc4-a82e-b644a5accd11"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:39:58.221906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-58a8edcc-0653-4b26-bf19-a53415e315f8 req-0e5ab826-7fe4-47e3-9e8e-8024259cce05 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:58.222472 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-58a8edcc-0653-4b26-bf19-a53415e315f8 req-0e5ab826-7fe4-47e3-9e8e-8024259cce05 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:58.237326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-58a8edcc-0653-4b26-bf19-a53415e315f8 req-0e5ab826-7fe4-47e3-9e8e-8024259cce05 service nova] Creating event network-vif-plugged:3311ac61-3d71-4bc4-a82e-b644a5accd11 for instance 846e301f-53f5-484c-9871-46e7472509ba on hv-cinder-79987 Jul 14 20:39:58.250522 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-58a8edcc-0653-4b26-bf19-a53415e315f8 req-0e5ab826-7fe4-47e3-9e8e-8024259cce05 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040903 Jul 14 20:39:58.251696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 325/659] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:39:58.306699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:58.314281 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-755a6d5d-04ae-4c0c-85e0-3961f9bc5df2 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.212309 Jul 14 20:39:58.315002 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 335/660] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:58 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:59.128221 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:59.130348 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:59.137549 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:59.138380 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:59.139828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:59.140324 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:59.334203 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:39:59.336157 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:39:59.344782 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:59.347683 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:59.348138 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:59.348936 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:39:59.349368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:39:59.352950 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9faa70b9-8183-4c61-9919-0b50879f6225 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.231494 Jul 14 20:39:59.355692 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 326/661] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:59 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:39:59.535412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:39:59.546242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1138493f-3ecc-4e00-936c-5f7365f6498a tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.217301 Jul 14 20:39:59.555587 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 336/662] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:39:59 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:00.372736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:00.373405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:00.381259 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:00.381909 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:00.382688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:00.383163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:00.519807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:00.527352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4c54cb40-923c-4440-8741-49f75e40f472 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.160483 Jul 14 20:40:00.527921 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 327/663] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:00 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:00.563040 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:00.563737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:00.570742 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:00.571435 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:00.572207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:00.572643 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:00.710722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:00.718918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7cc18ef3-4487-4115-8b97-9257569d6cb0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1366 microversion: 2.1 time: 0.159709 Jul 14 20:40:00.719882 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 337/664] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:00 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:01.547262 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:01.547877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:01.556650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:01.557326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:01.558156 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:01.558681 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:01.735832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:01.736518 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:01.739230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:01.744559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:01.745015 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:01.746018 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:01.746458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:01.817331 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:01.826024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3a469938-29ba-4dbf-aa48-4621e31e126e tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.285350 Jul 14 20:40:01.826736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 328/665] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:01 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:01.954824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:01.965115 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e50f5d26-bb9f-47ac-b46c-db929a7dea28 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1555 microversion: 2.1 time: 0.233590 Jul 14 20:40:01.965949 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 338/666] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:01 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:01.983459 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ed2be3ef-b2f1-4a83-843d-f419e5941b21 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:01.984209 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ed2be3ef-b2f1-4a83-843d-f419e5941b21 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:01.993571 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ed2be3ef-b2f1-4a83-843d-f419e5941b21 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:01.993957 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ed2be3ef-b2f1-4a83-843d-f419e5941b21 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:01.994820 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ed2be3ef-b2f1-4a83-843d-f419e5941b21 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:01.995524 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ed2be3ef-b2f1-4a83-843d-f419e5941b21 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:02.089312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ed2be3ef-b2f1-4a83-843d-f419e5941b21 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109001 Jul 14 20:40:02.091416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 329/667] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:40:01 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:02.844084 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:02.845673 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:02.858613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:02.859699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:02.861339 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:02.861935 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:02.985739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ff5fd5c6-b6bc-472a-a65a-5fb1a7664d6b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:02.986780 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ff5fd5c6-b6bc-472a-a65a-5fb1a7664d6b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:03.004789 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ff5fd5c6-b6bc-472a-a65a-5fb1a7664d6b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:03.005243 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ff5fd5c6-b6bc-472a-a65a-5fb1a7664d6b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:03.006426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ff5fd5c6-b6bc-472a-a65a-5fb1a7664d6b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:03.007007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ff5fd5c6-b6bc-472a-a65a-5fb1a7664d6b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:03.036848 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ff5fd5c6-b6bc-472a-a65a-5fb1a7664d6b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/ips" status: 200 len: 151 microversion: 2.20 time: 0.322883 Jul 14 20:40:03.038152 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 339/668] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Jul 14 20:40:02 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/ips => generated 151 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 20:40:03.177193 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:03.187635 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e36945f0-2c61-4ff8-8597-ce57077a4a5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.346698 Jul 14 20:40:03.190884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 330/669] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:02 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:03.401481 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-a068adfc-a80f-4e96-aaae-c34b7b9d9ca6 req-aa1acfc2-b229-41d7-b9e0-9013e139c742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846e301f-53f5-484c-9871-46e7472509ba", "tag": "3311ac61-3d71-4bc4-a82e-b644a5accd11"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:03.420112 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a068adfc-a80f-4e96-aaae-c34b7b9d9ca6 req-aa1acfc2-b229-41d7-b9e0-9013e139c742 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:03.421000 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a068adfc-a80f-4e96-aaae-c34b7b9d9ca6 req-aa1acfc2-b229-41d7-b9e0-9013e139c742 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:03.441313 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-a068adfc-a80f-4e96-aaae-c34b7b9d9ca6 req-aa1acfc2-b229-41d7-b9e0-9013e139c742 service nova] Creating event network-changed:3311ac61-3d71-4bc4-a82e-b644a5accd11 for instance 846e301f-53f5-484c-9871-46e7472509ba on hv-cinder-79987 Jul 14 20:40:03.446503 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-a068adfc-a80f-4e96-aaae-c34b7b9d9ca6 req-aa1acfc2-b229-41d7-b9e0-9013e139c742 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048746 Jul 14 20:40:03.447850 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 340/670] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:04.210540 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:04.211942 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:04.214770 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:04.222749 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:04.223524 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:04.224534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:04.225174 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:04.385011 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=8 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:04.576428 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:04.594711 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-abe2f86e-65ad-4731-9a25-c72442c31175 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.386657 Jul 14 20:40:04.595563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 331/671] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:04 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:05.005315 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:05.008194 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:05.016757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:05.017237 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:05.018657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:05.019168 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:05.025647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:05.057468 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lazy-loading 'flavor' on Instance uuid 8ea90cac-431b-48d8-8171-944bd150754f {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:40:05.466041 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cc5556a8-7568-463f-8e71-6431bbaa9171 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/action" status: 202 len: 0 microversion: 2.20 time: 0.465482 Jul 14 20:40:05.467311 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 341/672] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 14 20:40:04 2022] POST /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:40:05.476706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:05.477405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:05.484972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:05.497044 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:05.499970 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:05.500528 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:05.613967 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:05.614960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:05.622705 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:05.624091 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:05.625360 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:05.626171 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:05.899778 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:05.902357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=100 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:05.912614 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:05.915609 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:05.918097 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1f3641f7-8db3-4981-a347-540247eea255 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.445162 Jul 14 20:40:05.933188 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 332/673] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:05 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:06.024263 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:06.034800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-99a82d71-5b8d-4da3-b275-666c78561294 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.426780 Jul 14 20:40:06.035293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 342/674] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:05 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:06.814323 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e75c0a8e-7b3d-4cd0-9c6a-51f78d5af93b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'create', calling method: .version_select at 0x7fafb1964550>, body: {"keypair": {"name": "tempest-keypair-1624968022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMj6Y4vsGK75g248ts+NdW88TpRn+30mQ8VSGHpLnn5yBqHEwABs8d0BIhKYAe3OT8LeA6/VhuN7X1R1zGjZ3uZ7MNBhta5FJ++FmyJJL9x4D/DLLtg4QoOqzVUKSdaKQ=="}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:06.828732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-e75c0a8e-7b3d-4cd0-9c6a-51f78d5af93b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:40:06.832712 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-e75c0a8e-7b3d-4cd0-9c6a-51f78d5af93b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for user 813a2d3222f54b18a4322174a409183e and project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:40:06.859984 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e75c0a8e-7b3d-4cd0-9c6a-51f78d5af93b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113156 Jul 14 20:40:06.860807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 333/675] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:40:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:40:06.938081 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:06.939044 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:06.945604 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:06.946627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:06.947694 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:06.948331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:07.052154 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:07.053456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:07.059869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:07.061417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:07.062532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:07.063202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:07.214778 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:07.224828 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:07.226473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:07.228375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-66fd5905-2290-4939-8cca-5b7af7eb6fcb tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.294538 Jul 14 20:40:07.229013 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 343/676] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:06 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:40:07.294472 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:07.307497 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f88cafaa-9e89-4246-84e7-fa78c1963596 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.258429 Jul 14 20:40:07.308148 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 334/677] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:07 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:08.247553 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:08.249031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:08.256580 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:08.257402 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:08.258464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:08.259190 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:08.325379 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:08.328205 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:08.364380 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:08.395075 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:08.396772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:08.398675 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:08.487749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:08.504168 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:08.505969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:08.507374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-061b96e0-285b-4a3a-b9f6-397beb95d869 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.263788 Jul 14 20:40:08.509944 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 344/678] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:08 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:08.588182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-fa9dc43b-bfe7-4129-9967-3db4a4453697 req-dd3e47ef-f1a3-4fd9-ac7e-8b6b1b83933c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8165ae1-4719-48d2-9171-41ee878766c2", "name": "network-vif-plugged", "status": "completed", "tag": "9d7cb7f5-d312-41e5-b399-d59c90177499"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:08.605675 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-fa9dc43b-bfe7-4129-9967-3db4a4453697 req-dd3e47ef-f1a3-4fd9-ac7e-8b6b1b83933c service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:08.606140 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-fa9dc43b-bfe7-4129-9967-3db4a4453697 req-dd3e47ef-f1a3-4fd9-ac7e-8b6b1b83933c service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:08.610043 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:08.628296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-fa9dc43b-bfe7-4129-9967-3db4a4453697 req-dd3e47ef-f1a3-4fd9-ac7e-8b6b1b83933c service nova] Creating event network-vif-plugged:9d7cb7f5-d312-41e5-b399-d59c90177499 for instance d8165ae1-4719-48d2-9171-41ee878766c2 on hv-cinder-79987 Jul 14 20:40:08.630306 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-606d853e-fe76-4990-a1dc-920ff83614c1 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.309555 Jul 14 20:40:08.631493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 335/679] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:08 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:08.637575 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-fa9dc43b-bfe7-4129-9967-3db4a4453697 req-dd3e47ef-f1a3-4fd9-ac7e-8b6b1b83933c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053880 Jul 14 20:40:08.638722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 345/680] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:08.762166 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-893339005", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70ed2e9a-e979-4363-9c81-646389ddfcce"}], "security_groups": [{"name": "tempest-securitygroup--10805275"}], "key_name": "tempest-keypair-1624968022", "user_data": "}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:08.876981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] validate_networks() for [('70ed2e9a-e979-4363-9c81-646389ddfcce', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:40:09.370791 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:40:09.371365 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:40:09.371856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:40:09.372269 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:40:09.372684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:40:09.382440 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:09.382887 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:09.383718 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:09.384153 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:09.401848 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:40:09.406032 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for user 813a2d3222f54b18a4322174a409183e and project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:40:09.418047 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:40:09.420708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:40:09.471433 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cae1649d-b5b8-4f4e-9600-040ef007930d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.713526 Jul 14 20:40:09.472226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 336/681] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:40:08 2022] POST /compute/v2.1/servers => generated 400 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:40:09.483764 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5b3a166f-26f0-4c44-9c9a-ccd824da61a4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:09.484461 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5b3a166f-26f0-4c44-9c9a-ccd824da61a4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:09.531949 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:09.533144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:09.541854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:09.542307 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:09.543153 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:09.543852 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5b3a166f-26f0-4c44-9c9a-ccd824da61a4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:09.544159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:09.552031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5b3a166f-26f0-4c44-9c9a-ccd824da61a4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1237 microversion: 2.1 time: 0.073185 Jul 14 20:40:09.552972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 346/682] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:09 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:09.649201 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:09.650084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:09.662482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:09.662482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:09.662482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:09.662482 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:09.745272 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:09.757202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:09.758721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:09.759957 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-883ce51d-58a2-4ddc-8f0c-b6934fa244b1 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.231972 Jul 14 20:40:09.760969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 337/683] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:09 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:09.835736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:09.844821 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f39d068b-2060-49e5-b01d-68b500085ec9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1267 microversion: 2.1 time: 0.200889 Jul 14 20:40:09.855017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 347/684] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:09 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:10.569467 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:10.570111 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:10.577521 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:10.577976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:10.578751 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:10.579229 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:10.641351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:10.649107 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-82959f19-e988-4ba1-985c-971af5298eb1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1289 microversion: 2.1 time: 0.083480 Jul 14 20:40:10.649677 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 338/685] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:10 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:10.778218 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:10.778965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:10.785466 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:10.785914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:10.786683 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:10.787148 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:10.861609 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:10.862247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:10.868685 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:10.869171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:10.869906 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:10.870398 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:10.945889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:10.954457 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:10.955984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:10.957133 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3ecd04b3-a6e7-41cc-981c-27c90132c85c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.182880 Jul 14 20:40:10.957689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 348/686] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:10 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:11.014265 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:11.021990 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-09515ffe-8d68-4cd5-966e-6f12db1d5844 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1455 microversion: 2.1 time: 0.164220 Jul 14 20:40:11.022683 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 339/687] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:10 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:11.038783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:11.039371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:11.046162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:11.046615 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:11.047419 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:11.047862 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:11.218276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:11.228051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-48a87681-88e1-4fdb-a956-1338503d237c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1455 microversion: 2.1 time: 0.193114 Jul 14 20:40:11.228813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 349/688] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:11 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:11.668481 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:11.669699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:11.676913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:11.677410 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:11.678591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:11.679067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:11.766532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:11.776238 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a77df24f-ac3f-49bd-b6d0-3b86afbf5bc9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1295 microversion: 2.1 time: 0.112139 Jul 14 20:40:11.777213 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 340/689] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:11 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:11.975419 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:11.976033 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:11.983810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:11.984532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:11.985323 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:11.985844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:12.216413 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:12.230264 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:12.231960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:12.233207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5683c1cf-588e-4276-b875-3fd378fa21f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.261731 Jul 14 20:40:12.233770 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 350/690] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:11 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:40:12.797835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:12.798498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:12.806978 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:12.807441 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:12.808273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:12.808726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:13.037737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-16eedc92-b4ab-42d4-a0ab-d6beb3ea07d3 req-abc53c48-b369-4aea-a2db-83dadcac3014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fcf2cb-a1b4-4e88-83ba-1fdecb056836", "tag": "7aec5355-7bd2-42ec-8e1e-613974fa243f"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:13.052137 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:13.062616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fddf45c8-0cea-47b5-b172-8459cbe68ff4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1361 microversion: 2.1 time: 0.271208 Jul 14 20:40:13.067257 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 341/691] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:12 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:13.068877 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-16eedc92-b4ab-42d4-a0ab-d6beb3ea07d3 req-abc53c48-b369-4aea-a2db-83dadcac3014 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:13.069559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-16eedc92-b4ab-42d4-a0ab-d6beb3ea07d3 req-abc53c48-b369-4aea-a2db-83dadcac3014 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:13.102511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-16eedc92-b4ab-42d4-a0ab-d6beb3ea07d3 req-abc53c48-b369-4aea-a2db-83dadcac3014 service nova] Creating event network-changed:7aec5355-7bd2-42ec-8e1e-613974fa243f for instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 on hv-cinder-79987 Jul 14 20:40:13.109013 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-16eedc92-b4ab-42d4-a0ab-d6beb3ea07d3 req-abc53c48-b369-4aea-a2db-83dadcac3014 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168528 Jul 14 20:40:13.110178 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 351/692] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:13.168372 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-8a33f348-a77e-4e15-a6b3-367ce464c908 req-8da9c4aa-5f4d-47e1-8d9e-c99d69c78e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8165ae1-4719-48d2-9171-41ee878766c2", "tag": "9d7cb7f5-d312-41e5-b399-d59c90177499"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:13.177813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-8a33f348-a77e-4e15-a6b3-367ce464c908 req-8da9c4aa-5f4d-47e1-8d9e-c99d69c78e52 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:13.178657 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-8a33f348-a77e-4e15-a6b3-367ce464c908 req-8da9c4aa-5f4d-47e1-8d9e-c99d69c78e52 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:13.193631 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-8a33f348-a77e-4e15-a6b3-367ce464c908 req-8da9c4aa-5f4d-47e1-8d9e-c99d69c78e52 service nova] Creating event network-changed:9d7cb7f5-d312-41e5-b399-d59c90177499 for instance d8165ae1-4719-48d2-9171-41ee878766c2 on hv-cinder-79987 Jul 14 20:40:13.199464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-8a33f348-a77e-4e15-a6b3-367ce464c908 req-8da9c4aa-5f4d-47e1-8d9e-c99d69c78e52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130179 Jul 14 20:40:13.200243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 342/693] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:13.254119 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:13.255107 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:13.261875 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:13.263072 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:13.266408 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:13.266408 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:13.554525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:13.563589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:13.568770 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:13.568770 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-99d4e64a-7450-481a-b1da-751293de211a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.317609 Jul 14 20:40:13.570883 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 352/694] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:13 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:14.083706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:14.084566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:14.091500 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:14.091957 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:14.092773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:14.093218 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:14.523255 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:14.531893 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-dc403da9-399c-4e6c-8727-21e3c380ab76 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1361 microversion: 2.1 time: 0.451818 Jul 14 20:40:14.531893 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 343/695] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:14 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1361 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:14.584579 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:14.585187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:14.591919 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:14.592371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:14.593173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:14.593611 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:14.723046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:14.731095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:14.733213 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:14.734363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0cad2f8d-2a90-4b4e-ab05-d3e94304a442 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.153739 Jul 14 20:40:14.734921 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 353/696] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:14 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:15.549551 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:15.550166 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:15.556924 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:15.557374 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:15.558148 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:15.558590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:15.697686 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:15.705271 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a695bf81-3a34-4f91-9f16-1df90b3fb135 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1361 microversion: 2.1 time: 0.159589 Jul 14 20:40:15.705844 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 344/697] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:15 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:15.752890 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:15.753494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:15.759930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:15.760377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:15.761133 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:15.761565 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:15.888845 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:15.897187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:15.898687 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:15.899873 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e3f0dc97-e456-420e-8b9b-94a40ecb3e97 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.150834 Jul 14 20:40:15.900438 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 354/698] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:15 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:16.722930 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:16.723517 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:16.730029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:16.730486 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:16.731312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:16.731759 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:16.872270 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:16.879964 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-97e36071-5b33-48e2-97d8-8ed8a2646d0a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1361 microversion: 2.1 time: 0.160953 Jul 14 20:40:16.880533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 345/699] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:16 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:16.917716 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:16.918337 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:16.925048 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:16.925526 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:16.926296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:16.926733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:17.059979 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:17.069386 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:17.070879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:17.072055 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4b5f5a2b-8406-4da8-8c8d-3cafceefcf01 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.158423 Jul 14 20:40:17.072611 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 355/700] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:16 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:40:17.898177 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:17.898708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:17.905545 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:17.905994 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:17.906773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:17.907276 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.052390 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:18.061784 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-95a8c165-ce16-4ca3-b244-8beca34e2b2f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1361 microversion: 2.1 time: 0.167839 Jul 14 20:40:18.062672 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 346/701] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:17 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:18.092426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:18.094198 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:18.102091 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:18.102583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.103938 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:18.104677 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.219014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-815751a3-3e6e-49f7-b82f-eefa83f246ac req-a76b9e4d-fef2-4a04-93ca-4c15455fc731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fcf2cb-a1b4-4e88-83ba-1fdecb056836", "name": "network-vif-plugged", "status": "completed", "tag": "7aec5355-7bd2-42ec-8e1e-613974fa243f"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:18.228317 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-815751a3-3e6e-49f7-b82f-eefa83f246ac req-a76b9e4d-fef2-4a04-93ca-4c15455fc731 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:18.228822 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-815751a3-3e6e-49f7-b82f-eefa83f246ac req-a76b9e4d-fef2-4a04-93ca-4c15455fc731 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.242121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-815751a3-3e6e-49f7-b82f-eefa83f246ac req-a76b9e4d-fef2-4a04-93ca-4c15455fc731 service nova] Creating event network-vif-plugged:7aec5355-7bd2-42ec-8e1e-613974fa243f for instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 on hv-cinder-79987 Jul 14 20:40:18.247678 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-815751a3-3e6e-49f7-b82f-eefa83f246ac req-a76b9e4d-fef2-4a04-93ca-4c15455fc731 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032681 Jul 14 20:40:18.249295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 347/702] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:18.286751 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:18.297096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:18.298637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:18.299905 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-69be6b77-040a-401c-9962-ebe26e1bd46c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.212563 Jul 14 20:40:18.300487 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 356/703] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:18 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:18.459419 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-eac5acc9-c224-40e7-8b65-345af62edfd0 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:18.460436 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-eac5acc9-c224-40e7-8b65-345af62edfd0 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:18.462535 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:18.468970 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-eac5acc9-c224-40e7-8b65-345af62edfd0 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:18.469411 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-eac5acc9-c224-40e7-8b65-345af62edfd0 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.470192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-eac5acc9-c224-40e7-8b65-345af62edfd0 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:18.470618 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-eac5acc9-c224-40e7-8b65-345af62edfd0 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.553359 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-eac5acc9-c224-40e7-8b65-345af62edfd0 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/action" status: 202 len: 0 microversion: 2.1 time: 0.098248 Jul 14 20:40:18.554032 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 348/704] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:40:18 2022] POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:40:18.563792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:18.564736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:18.572689 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:18.573439 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.574242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:18.574818 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:18.732915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:18.741395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-03606f59-7d27-409a-8746-eeb0acd821be tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1750 microversion: 2.1 time: 0.181540 Jul 14 20:40:18.742182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 357/705] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:18 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:19.080411 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:19.081160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:19.087485 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:19.087933 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:19.088716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:19.089180 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:19.228517 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:19.236375 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-259e8c58-8c39-4033-9f66-afa847eda537 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1361 microversion: 2.1 time: 0.161159 Jul 14 20:40:19.236959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 349/706] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:19 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:19.329348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:19.329949 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:19.336722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:19.337169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:19.337941 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:19.338385 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:19.342695 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:19.545830 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:19.548318 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:19.555838 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:19.557361 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:19.558538 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8ffa54c9-ae6c-4a82-92b8-99b65350e50c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.233691 Jul 14 20:40:19.559131 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 358/707] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:19 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:19.760288 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:19.761050 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:19.764707 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:19.765496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=10 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:19.770601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:19.771215 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:19.772084 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:19.772641 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:19.948292 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:19.957136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cebb2a49-4ddc-4240-88f5-3db8a1319d8c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1750 microversion: 2.1 time: 0.200850 Jul 14 20:40:19.957710 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 350/708] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:19 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:20.255155 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:20.255768 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:20.262296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.262744 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:20.264127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.264548 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:20.457798 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:20.465680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-69909e54-2469-4168-89db-6e8149bf835b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1547 microversion: 2.1 time: 0.214720 Jul 14 20:40:20.466269 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 359/709] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:20 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1547 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:40:20.483257 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-10385bda-fc04-4bc7-9e66-b27646ac8e22 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:20.483815 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-10385bda-fc04-4bc7-9e66-b27646ac8e22 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:20.490821 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-10385bda-fc04-4bc7-9e66-b27646ac8e22 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.491389 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-10385bda-fc04-4bc7-9e66-b27646ac8e22 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:20.492243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-10385bda-fc04-4bc7-9e66-b27646ac8e22 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.492816 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-10385bda-fc04-4bc7-9e66-b27646ac8e22 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:20.508376 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:20.577092 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:20.577757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:20.584070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.584613 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:20.585456 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.585966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:20.610543 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-10385bda-fc04-4bc7-9e66-b27646ac8e22 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131845 Jul 14 20:40:20.611629 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 351/710] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:40:20 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:20.766771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:20.775226 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:20.776743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:20.777912 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d64ccdd2-f441-4fa9-bf89-ff5fd8c6a95f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.204823 Jul 14 20:40:20.778473 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 360/711] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:20 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:40:20.973828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:20.974605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:20.981416 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.981916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:20.983590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:20.984178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:21.143567 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:21.151894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-94c3edd5-28a8-418f-87d9-43d4758ce7f3 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1750 microversion: 2.1 time: 0.182105 Jul 14 20:40:21.152468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 352/712] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:20 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:21.566421 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-fcb26527-7a9e-4b8d-8d86-89f4a18eea7e req-3ae3a052-3a6d-4287-b36c-ecdefa25270b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fcf2cb-a1b4-4e88-83ba-1fdecb056836", "tag": "7aec5355-7bd2-42ec-8e1e-613974fa243f"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:21.574884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-fcb26527-7a9e-4b8d-8d86-89f4a18eea7e req-3ae3a052-3a6d-4287-b36c-ecdefa25270b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:21.575357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-fcb26527-7a9e-4b8d-8d86-89f4a18eea7e req-3ae3a052-3a6d-4287-b36c-ecdefa25270b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:21.586763 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-fcb26527-7a9e-4b8d-8d86-89f4a18eea7e req-3ae3a052-3a6d-4287-b36c-ecdefa25270b service nova] Creating event network-changed:7aec5355-7bd2-42ec-8e1e-613974fa243f for instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 on hv-cinder-79987 Jul 14 20:40:21.592024 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-fcb26527-7a9e-4b8d-8d86-89f4a18eea7e req-3ae3a052-3a6d-4287-b36c-ecdefa25270b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029351 Jul 14 20:40:21.592786 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 361/713] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:21.797659 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:21.798483 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:21.805945 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:21.806427 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:21.807544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:21.808141 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:22.022497 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:22.037677 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:22.039243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:22.040515 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ceef319f-cf72-4540-b1e2-9120375ceb02 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1744 microversion: 2.20 time: 0.247061 Jul 14 20:40:22.041456 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 353/714] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:21 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1744 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:22.171406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:22.172117 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:22.178616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:22.179140 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:22.179995 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:22.180778 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:22.367058 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:22.381609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8c140dba-34f5-42fa-a0a0-08771ab59c8d tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.215020 Jul 14 20:40:22.382345 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 362/715] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:22 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:23.060527 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:23.061510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:23.069425 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:23.069886 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:23.070701 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:23.071179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:23.211267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:23.219605 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:23.221099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:23.222258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d26bce92-f217-4ad6-9f49-62989bf1ad74 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1744 microversion: 2.20 time: 0.166912 Jul 14 20:40:23.222813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 354/716] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:23 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:23.400031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:23.400629 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:23.407216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:23.407670 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:23.408437 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:23.408870 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:23.557173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:23.565896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ca85aa0d-d193-4816-be91-f5cc3300bd44 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.169756 Jul 14 20:40:23.566500 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 363/717] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:23 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:24.242549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:24.243214 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:24.255693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:24.256153 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:24.256973 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:24.257420 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:24.343511 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-80aab3f2-83ed-4ac1-ab18-c725d1ed86a4 req-1dfc5382-465e-4802-a39d-cc1ee792ec0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea90cac-431b-48d8-8171-944bd150754f", "name": "network-vif-plugged", "status": "completed", "tag": "a450ed13-0148-4da1-9b7d-201016068164"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:24.352498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-80aab3f2-83ed-4ac1-ab18-c725d1ed86a4 req-1dfc5382-465e-4802-a39d-cc1ee792ec0a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:24.352957 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-80aab3f2-83ed-4ac1-ab18-c725d1ed86a4 req-1dfc5382-465e-4802-a39d-cc1ee792ec0a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:24.365382 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-80aab3f2-83ed-4ac1-ab18-c725d1ed86a4 req-1dfc5382-465e-4802-a39d-cc1ee792ec0a service nova] Creating event network-vif-plugged:a450ed13-0148-4da1-9b7d-201016068164 for instance 8ea90cac-431b-48d8-8171-944bd150754f on hv-cinder-79987 Jul 14 20:40:24.371189 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-80aab3f2-83ed-4ac1-ab18-c725d1ed86a4 req-1dfc5382-465e-4802-a39d-cc1ee792ec0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147528 Jul 14 20:40:24.372128 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 355/718] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:24.451268 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:24.460912 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:24.462433 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:24.463802 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6785d76b-5c2a-47fa-b2f7-225195c9ee94 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.225613 Jul 14 20:40:24.464692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 364/719] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:24 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:40:24.591805 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:24.592912 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:24.602233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:24.602696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:24.603639 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:24.604083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:24.818732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:24.830749 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5e47ba3c-7983-4c05-b68f-bf9761da5cab tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.248738 Jul 14 20:40:24.846048 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 356/720] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:24 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:25.485352 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:25.486758 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:25.494125 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:25.494578 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:25.495380 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:25.496016 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:25.673612 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:25.689673 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:25.691550 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:25.692927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5a47baac-de9d-414a-a948-b63e8185d0b7 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.212610 Jul 14 20:40:25.693486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 365/721] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:25 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:25.851304 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:25.851938 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:25.859545 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:25.860345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:25.861351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:25.862455 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:26.030183 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:26.038494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5aac9449-33df-4ec8-aa88-4f27f5991ca9 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.191136 Jul 14 20:40:26.039093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 357/722] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:25 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:26.712960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:26.714250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:26.721752 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:26.722457 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:26.723371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:26.724002 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:26.929249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:26.940400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:26.941939 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:26.943338 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-50497b30-a6e0-4554-98e9-e7bdd1a5b202 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.235065 Jul 14 20:40:26.943893 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 366/723] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:26 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:27.055667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:27.057113 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:27.065148 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:27.065845 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:27.066792 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:27.067512 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:27.246145 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:27.254862 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-cf39e500-560f-4034-bb84-99f30ba7c743 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.202935 Jul 14 20:40:27.255484 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 358/724] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:27 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:27.963387 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:27.964684 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:27.973493 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:27.974185 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:27.975189 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:27.975631 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:28.133896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:28.142594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:28.144174 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:28.145811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-67cf280b-77dd-45d9-8290-2607ef72810d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.186620 Jul 14 20:40:28.146371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 367/725] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:27 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:28.274644 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:28.275413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:28.287472 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:28.288309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:28.289163 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:28.289978 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:28.457740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:28.466747 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9248cbb3-34cf-4dd3-9ea9-d2bc22828c2c tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.195912 Jul 14 20:40:28.468129 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 359/726] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:28 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:29.164708 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:29.165304 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:29.172450 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:29.172907 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:29.173690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:29.174348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:29.326200 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:29.335227 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:29.338039 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:29.339261 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c3818543-1eec-4c96-a78d-30e8152e131d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.178463 Jul 14 20:40:29.340079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 368/727] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:29 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:29.485342 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:29.486776 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:29.493641 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:29.494876 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:29.495983 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:29.496547 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:29.671273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:29.681844 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-262bc49a-5eb4-471e-82dd-4afec3ba2565 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.200837 Jul 14 20:40:29.692151 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 360/728] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:29 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:30.358043 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:30.359357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:30.366312 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:30.367158 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:30.368173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:30.368617 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:30.534582 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:30.543655 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:30.545833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:30.547033 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2ccac5be-c822-4e8d-940d-4d3b5e642816 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.193150 Jul 14 20:40:30.547591 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 369/729] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:30 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:30.699961 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:30.700720 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:30.707543 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:30.708003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:30.708975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:30.709508 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:30.893260 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:30.906072 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-13bf8867-b373-41e2-a0a4-7c8dcb68b85a tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.210304 Jul 14 20:40:30.917812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 361/730] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:30 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:31.567578 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:31.571966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:31.581248 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:31.581740 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:31.582526 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:31.583214 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:31.780177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:31.790077 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:31.791746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:31.793346 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4e3c2df3-ae04-4857-b2db-f65f68cbc25e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.229701 Jul 14 20:40:31.802858 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 370/731] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:31 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:31.927680 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:31.928287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:31.935466 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:31.935908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:31.936880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:31.937544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:32.119621 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:32.129194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6b7508f8-57d0-4c04-868d-365f22dab760 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1755 microversion: 2.1 time: 0.205210 Jul 14 20:40:32.130386 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 362/732] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:31 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:32.813940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:32.814546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:32.817479 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=68 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:32.823647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:32.824458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:32.826059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:32.826705 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:32.980667 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:32.992149 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:32.993761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:32.995057 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-71c413f0-2dde-4043-89bc-76fb154104a2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.185873 Jul 14 20:40:32.995691 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 371/733] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:32 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:33.146761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:33.147594 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:33.154074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:33.154790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:33.155667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:33.156049 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:33.326530 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:33.334840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-efb40530-bb72-4b85-a87c-92ecd6b2fe75 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1758 microversion: 2.1 time: 0.192241 Jul 14 20:40:33.336081 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 363/734] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:40:33 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:40:34.014445 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:34.015087 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:34.022045 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:34.022494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:34.023302 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:34.023738 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:34.165397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:34.173774 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:34.175327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:34.176514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-71d03acf-8d0f-4eaa-b881-71385895824a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1739 microversion: 2.20 time: 0.166646 Jul 14 20:40:34.177085 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 372/735] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:34 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:35.195040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:35.195650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:35.203168 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:35.203594 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:35.204477 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:35.204916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:35.337615 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:35.346080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:35.347610 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:35.348755 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-625fa96f-ab5c-4fc9-aec1-60969a1dda5e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1721 microversion: 2.20 time: 0.157829 Jul 14 20:40:35.349308 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 364/736] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:35 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:36.246166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-468bfb15-0472-4317-9de5-d6b69a3d2d5e req-2a7727db-dd4b-4000-8ba9-6d9dceed7927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea90cac-431b-48d8-8171-944bd150754f", "name": "network-vif-unplugged", "status": "completed", "tag": "a450ed13-0148-4da1-9b7d-201016068164"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:36.256965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-468bfb15-0472-4317-9de5-d6b69a3d2d5e req-2a7727db-dd4b-4000-8ba9-6d9dceed7927 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:36.257492 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-468bfb15-0472-4317-9de5-d6b69a3d2d5e req-2a7727db-dd4b-4000-8ba9-6d9dceed7927 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:36.269293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-468bfb15-0472-4317-9de5-d6b69a3d2d5e req-2a7727db-dd4b-4000-8ba9-6d9dceed7927 service nova] Creating event network-vif-unplugged:a450ed13-0148-4da1-9b7d-201016068164 for instance 8ea90cac-431b-48d8-8171-944bd150754f on hv-cinder-79987 Jul 14 20:40:36.274754 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-468bfb15-0472-4317-9de5-d6b69a3d2d5e req-2a7727db-dd4b-4000-8ba9-6d9dceed7927 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032232 Jul 14 20:40:36.275390 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 373/737] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:36.367402 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:36.368047 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:36.375878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:36.376325 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:36.377230 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:36.377667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:36.524587 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:36.533135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:36.534664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:36.535854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-51272f48-9753-4112-9ac1-815e0c112994 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1721 microversion: 2.20 time: 0.172554 Jul 14 20:40:36.536413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 365/738] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:36 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:37.555867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:37.556563 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:37.563359 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:37.563820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:37.564600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:37.565040 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:37.697969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:37.706454 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:37.708020 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:37.709266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6aa5d9b2-5105-4691-9d59-707fcff36f34 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1664 microversion: 2.20 time: 0.157712 Jul 14 20:40:37.709823 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 374/739] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:37 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:37.727923 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-af68fc25-82a7-4dd6-af20-802bb6802575 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32e81662-6897-440d-b6e6-6962c0fb3318"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:37.729056 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-af68fc25-82a7-4dd6-af20-802bb6802575 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:37.735713 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-af68fc25-82a7-4dd6-af20-802bb6802575 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:37.736166 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-af68fc25-82a7-4dd6-af20-802bb6802575 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:37.737012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-af68fc25-82a7-4dd6-af20-802bb6802575 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:37.737452 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-af68fc25-82a7-4dd6-af20-802bb6802575 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:37.985959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:37.999599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-af68fc25-82a7-4dd6-af20-802bb6802575 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275714 Jul 14 20:40:38.000210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 366/740] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Jul 14 20:40:37 2022] POST /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 20:40:38.112918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-812ab004-3041-459a-9e58-e815b3c53eab tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:38.113416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-812ab004-3041-459a-9e58-e815b3c53eab tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:38.119525 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-812ab004-3041-459a-9e58-e815b3c53eab tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:38.119981 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-812ab004-3041-459a-9e58-e815b3c53eab tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:38.120751 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-812ab004-3041-459a-9e58-e815b3c53eab tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:38.121190 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-812ab004-3041-459a-9e58-e815b3c53eab tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:38.202820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:38.386620 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-812ab004-3041-459a-9e58-e815b3c53eab tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-volume_attachments/32e81662-6897-440d-b6e6-6962c0fb3318" status: 202 len: 0 microversion: 2.20 time: 0.277709 Jul 14 20:40:38.387342 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 375/741] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Jul 14 20:40:38 2022] DELETE /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-volume_attachments/32e81662-6897-440d-b6e6-6962c0fb3318 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:40:38.443100 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a8214184-4646-4e49-836f-7a62c3cc92b5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:38.443657 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a8214184-4646-4e49-836f-7a62c3cc92b5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:38.449660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8214184-4646-4e49-836f-7a62c3cc92b5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:38.450155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8214184-4646-4e49-836f-7a62c3cc92b5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:38.450989 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8214184-4646-4e49-836f-7a62c3cc92b5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:38.451373 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8214184-4646-4e49-836f-7a62c3cc92b5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:38.543309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a8214184-4646-4e49-836f-7a62c3cc92b5 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "POST /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/action" status: 202 len: 0 microversion: 2.20 time: 0.103904 Jul 14 20:40:38.544540 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 367/742] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 14 20:40:38 2022] POST /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:40:38.552749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:38.553359 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:38.563951 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:38.564562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:38.565399 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:38.565901 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:38.742451 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:38.750476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:38.751995 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:38.753138 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-21031d22-1a77-47be-a965-bfa9e9496fde tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1672 microversion: 2.20 time: 0.204371 Jul 14 20:40:38.753736 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 376/743] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:38 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:40:39.771418 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:39.772032 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:39.780052 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:39.780500 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:39.781266 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:39.781703 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:39.909976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:39.918288 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:39.919877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:39.921016 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6800219a-c168-4efb-a730-57858935706c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.153848 Jul 14 20:40:39.921634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 368/744] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:39 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:40.939605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:40.940219 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:40.946906 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:40.947392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:40.948168 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:40.948618 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:41.082233 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:41.090254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:41.091786 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:41.092946 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9b5b6ed1-b13f-46fb-a2eb-73105777ff2d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.157222 Jul 14 20:40:41.093531 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 377/745] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:40 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:42.113726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:42.114691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:42.121087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:42.121654 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:42.123060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:42.123907 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:42.270754 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:42.278992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:42.280521 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:42.281699 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0a993507-0c0d-4cae-924e-0e3be44333df tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.172047 Jul 14 20:40:42.282258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 369/746] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:42 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:43.300376 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:43.301174 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:43.307776 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:43.308219 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:43.309041 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:43.309431 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:43.470110 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:43.482207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:43.483767 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:43.484952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b519d475-1068-4efb-9eb3-db610f43b7e6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.188765 Jul 14 20:40:43.485521 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 378/747] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:43 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:44.507347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:44.508473 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:44.520637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:44.521263 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:44.522367 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:44.523563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:44.691112 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:44.700160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:44.702233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:44.703440 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-18d05ad2-b878-4377-99eb-22953b0d2ac2 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.202038 Jul 14 20:40:44.703994 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 370/748] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:44 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:45.721582 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:45.722333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:45.729182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:45.729638 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:45.730407 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:45.730846 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:45.870735 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:45.879401 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:45.880925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:45.882083 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0efa4bef-cbdd-49df-900e-8ba1b36d56db tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.164469 Jul 14 20:40:45.882646 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 379/749] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:45 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:46.900974 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:46.901704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:46.908325 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:46.908777 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:46.909560 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:46.910003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:47.200234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:47.208534 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:47.209929 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:47.211146 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-bace086f-3af2-4e5c-b078-28d10b59af5d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.314328 Jul 14 20:40:47.211698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 371/750] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:46 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:48.229298 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:48.229934 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:48.236458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:48.236913 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:48.237686 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:48.238141 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:48.374796 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:48.383960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:48.385590 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:48.386838 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-87dae4f1-0e55-44e2-a45f-14765fe4331a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.161478 Jul 14 20:40:48.387432 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 380/751] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:48 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:49.406394 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:49.407020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:49.409386 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=50 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:40:49.415109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:49.415559 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:49.416361 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:49.416799 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:49.558439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:49.567109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:49.568622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:49.569787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a52f8fe8-4aee-4545-957e-3293cfc8b1d6 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.167963 Jul 14 20:40:49.570522 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 372/752] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:49 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:50.590068 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:50.590710 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:50.598189 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:50.598652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:50.599471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:50.599929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:50.746798 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:50.756668 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:50.758425 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:50.759626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4d79bd52-4711-44e0-a80a-6f4b01dbaeed tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.174401 Jul 14 20:40:50.760535 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 381/753] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:50 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:51.191891 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f05a0c3b-c7bf-463b-b094-ae637ff65a78 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:51.192481 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f05a0c3b-c7bf-463b-b094-ae637ff65a78 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:51.198864 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f05a0c3b-c7bf-463b-b094-ae637ff65a78 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:51.199345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f05a0c3b-c7bf-463b-b094-ae637ff65a78 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:51.200115 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f05a0c3b-c7bf-463b-b094-ae637ff65a78 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:51.200554 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f05a0c3b-c7bf-463b-b094-ae637ff65a78 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:51.224666 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f05a0c3b-c7bf-463b-b094-ae637ff65a78 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/ips" status: 200 len: 148 microversion: 2.1 time: 0.036670 Jul 14 20:40:51.225130 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 373/754] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:40:51 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:51.780081 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:51.780706 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:51.787409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:51.787860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:51.788633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:51.789068 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:51.920662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:51.929445 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:51.931276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:51.932694 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-260acce1-50af-4e2c-b0fb-b7ea38395f6f tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.156617 Jul 14 20:40:51.933395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 382/755] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:51 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:52.543496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-46a75cff-89e1-4ddf-b9c8-aaa6dd2b6396 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5f6c71c-2890-44a5-9a42-ca54a3bad090"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:52.544616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-46a75cff-89e1-4ddf-b9c8-aaa6dd2b6396 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:52.551223 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46a75cff-89e1-4ddf-b9c8-aaa6dd2b6396 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:52.551672 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46a75cff-89e1-4ddf-b9c8-aaa6dd2b6396 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:52.552435 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46a75cff-89e1-4ddf-b9c8-aaa6dd2b6396 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:52.552873 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46a75cff-89e1-4ddf-b9c8-aaa6dd2b6396 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:52.889670 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-46a75cff-89e1-4ddf-b9c8-aaa6dd2b6396 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "POST /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349940 Jul 14 20:40:52.890267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 374/756] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:40:52 2022] POST /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:52.951996 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:52.952606 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:52.959142 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:52.959576 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:52.960341 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:52.960770 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:53.088594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:53.096805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:53.098324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:53.099498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-af0bc5bd-99e1-4ce0-bd05-d34f3e437070 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.152521 Jul 14 20:40:53.100064 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 383/757] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:52 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:54.119922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:54.120609 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:54.127089 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:54.127545 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:54.128307 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:54.128744 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:54.263169 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:54.271427 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:54.272924 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:54.274121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ab4b22e5-0698-4ed5-89ad-48b5aa7e52af tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.158971 Jul 14 20:40:54.274616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 375/758] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:54 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:55.292826 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:55.293432 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:55.300415 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:55.300864 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:55.301660 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:55.302095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:55.433091 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:55.441677 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:55.443213 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:55.444353 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2093d8dd-5133-45b1-a2e9-3582dad6925d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.155528 Jul 14 20:40:55.444914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 384/759] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:55 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:56.356318 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-3f934371-4fed-4a25-9fcb-92e4b02c9cdc req-939b2daf-f256-46eb-bc71-a03b5f605be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea90cac-431b-48d8-8171-944bd150754f", "name": "network-vif-plugged", "status": "completed", "tag": "a450ed13-0148-4da1-9b7d-201016068164"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:40:56.366282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3f934371-4fed-4a25-9fcb-92e4b02c9cdc req-939b2daf-f256-46eb-bc71-a03b5f605be4 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:56.366920 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3f934371-4fed-4a25-9fcb-92e4b02c9cdc req-939b2daf-f256-46eb-bc71-a03b5f605be4 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:56.380089 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-3f934371-4fed-4a25-9fcb-92e4b02c9cdc req-939b2daf-f256-46eb-bc71-a03b5f605be4 service nova] Creating event network-vif-plugged:a450ed13-0148-4da1-9b7d-201016068164 for instance 8ea90cac-431b-48d8-8171-944bd150754f on hv-cinder-79987 Jul 14 20:40:56.384998 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-3f934371-4fed-4a25-9fcb-92e4b02c9cdc req-939b2daf-f256-46eb-bc71-a03b5f605be4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Jul 14 20:40:56.385817 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 376/760] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:40:56.462268 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:56.462883 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:56.469600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:56.470043 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:56.470811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:56.471267 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:56.911788 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:56.920298 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:56.921802 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:56.922985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c0c1433a-5e72-4fa4-8f1a-3ee424f86ffd tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.464942 Jul 14 20:40:56.923548 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 385/761] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:56 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:57.942171 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:57.942773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:57.948987 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:57.949688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:57.950267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:57.950956 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:58.082480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:58.091428 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:58.092999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:58.094074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4c6f0a6a-95b7-4ccf-b1c3-ac8c5560742b tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1730 microversion: 2.20 time: 0.156711 Jul 14 20:40:58.094619 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 377/762] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:57 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:40:59.112479 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:40:59.113089 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:40:59.119618 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:59.120062 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:59.120822 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:40:59.121257 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:40:59.248990 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:59.257088 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:59.258718 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:40:59.259932 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-585e9c77-3ef0-4caf-bb72-bfe938213b7a tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1717 microversion: 2.20 time: 0.151408 Jul 14 20:40:59.260501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 386/763] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:40:59 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:41:00.475838 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:00.476370 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:00.483653 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:00.484098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:00.484864 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:00.485297 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:00.564028 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lazy-loading 'services' on Instance uuid 846e301f-53f5-484c-9871-46e7472509ba {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:41:00.635579 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-da1f0997-b60c-4d30-8747-c327294098dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments/c5f6c71c-2890-44a5-9a42-ca54a3bad090" status: 202 len: 0 microversion: 2.1 time: 0.163404 Jul 14 20:41:00.636378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 378/764] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:41:00 2022] DELETE /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments/c5f6c71c-2890-44a5-9a42-ca54a3bad090 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:41:00.645489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-268e4c25-25df-4858-a0c8-7076f33c191c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:00.646476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-268e4c25-25df-4858-a0c8-7076f33c191c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:00.654150 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-268e4c25-25df-4858-a0c8-7076f33c191c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:00.654519 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-268e4c25-25df-4858-a0c8-7076f33c191c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:00.655388 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-268e4c25-25df-4858-a0c8-7076f33c191c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:00.655819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-268e4c25-25df-4858-a0c8-7076f33c191c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:00.686652 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-268e4c25-25df-4858-a0c8-7076f33c191c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Jul 14 20:41:00.687252 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 387/765] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:41:00 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:01.698428 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4261ee04-5670-4df8-85c4-332f43f78c23 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:01.699516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4261ee04-5670-4df8-85c4-332f43f78c23 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:01.706736 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4261ee04-5670-4df8-85c4-332f43f78c23 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:01.707397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4261ee04-5670-4df8-85c4-332f43f78c23 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:01.708160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4261ee04-5670-4df8-85c4-332f43f78c23 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:01.708591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4261ee04-5670-4df8-85c4-332f43f78c23 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:01.737753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4261ee04-5670-4df8-85c4-332f43f78c23 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043657 Jul 14 20:41:01.738310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 379/766] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:41:01 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 20:41:01.801690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:01.802800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:01.810835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:01.811313 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:01.812079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:01.812561 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:01.837260 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:41:01.887878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:01.915925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f9a15107-fca3-4865-8b70-d5aa7d91aa2c tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 204 len: 0 microversion: 2.1 time: 0.121158 Jul 14 20:41:01.916713 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 388/767] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:41:01 2022] DELETE /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:41:01.925106 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:01.925709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:01.931805 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:01.932252 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:01.933017 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:01.933448 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:02.065821 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:02.073505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a54e49a5-ba7f-4f84-95ad-0a5e71c58a74 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1679 microversion: 2.1 time: 0.152213 Jul 14 20:41:02.074068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 380/768] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:01 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:03.091977 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:03.092681 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:03.095166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:03.102905 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:03.103392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:03.104190 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:03.104628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:03.259698 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:03.267720 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ed0aa369-9091-4ee3-86de-63b31ef94bc8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1679 microversion: 2.1 time: 0.179866 Jul 14 20:41:03.268306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 389/769] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:03 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:04.285358 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:04.285968 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:04.293144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:04.294180 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:04.294982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:04.295426 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:04.299934 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:04.568331 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c6975c73954487a1f15649693b1d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40baf66113cf4fb186ddd5e954a9b7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:04.576104 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e22ff741-12d7-4241-9ccb-179105dd93dc tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 200 len: 1679 microversion: 2.1 time: 0.294758 Jul 14 20:41:04.576662 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 381/770] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:04 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 1679 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:04.758354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-faf61ea1-9f46-46bc-8e77-82f7009e087d req-0b18ea7a-6980-4f9a-ad6e-9449b5198284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846e301f-53f5-484c-9871-46e7472509ba", "name": "network-vif-deleted", "tag": "3311ac61-3d71-4bc4-a82e-b644a5accd11"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:04.770291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-faf61ea1-9f46-46bc-8e77-82f7009e087d req-0b18ea7a-6980-4f9a-ad6e-9449b5198284 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:04.770647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-faf61ea1-9f46-46bc-8e77-82f7009e087d req-0b18ea7a-6980-4f9a-ad6e-9449b5198284 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:04.783857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-faf61ea1-9f46-46bc-8e77-82f7009e087d req-0b18ea7a-6980-4f9a-ad6e-9449b5198284 service nova] Creating event network-vif-deleted:3311ac61-3d71-4bc4-a82e-b644a5accd11 for instance 846e301f-53f5-484c-9871-46e7472509ba on hv-cinder-79987 Jul 14 20:41:04.790417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-faf61ea1-9f46-46bc-8e77-82f7009e087d req-0b18ea7a-6980-4f9a-ad6e-9449b5198284 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035706 Jul 14 20:41:04.791372 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 390/771] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:05.593602 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:05.594281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:05.600837 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:05.601388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:05.602066 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:05.602537 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:05.616459 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba HTTP/1.1 Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:05.618136 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:05.619539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '846e301f-53f5-484c-9871-46e7472509ba'} Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:05.620444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:05.622498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:05.624648 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:05.624648 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6f08e450-3a57-4bc7-82f3-31b718725707 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 404 len: 111 microversion: 2.1 time: 0.029945 Jul 14 20:41:05.624648 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 382/772] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:05 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:05.629795 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-74acb03b-7775-4698-82dc-d6ab4d24c6a6 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '.version_select at 0x7fafb1901040>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:05.651109 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-74acb03b-7775-4698-82dc-d6ab4d24c6a6 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752125852" status: 202 len: 0 microversion: 2.1 time: 0.025255 Jul 14 20:41:05.651498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 391/773] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 14 20:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752125852 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:41:07.395281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:07.395772 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:07.402291 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:07.402765 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:07.403585 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:07.404026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:07.417293 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba HTTP/1.1 Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:07.418833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.420491 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '846e301f-53f5-484c-9871-46e7472509ba'} Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:07.421381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.422879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.424664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:07.424664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7efb5589-3c76-45cf-a7ba-bafe384d2c47 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 404 len: 111 microversion: 2.1 time: 0.029103 Jul 14 20:41:07.424664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 383/774] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:41:07 2022] DELETE /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:07.429790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:07.430515 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 846e301f-53f5-484c-9871-46e7472509ba] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:07.437300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:07.437755 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:07.438519 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:07.439001 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:07.453359 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba HTTP/1.1 Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:07.455262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.456898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '846e301f-53f5-484c-9871-46e7472509ba'} Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:07.457761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. Jul 14 20:41:07.459209 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:07.460455 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 846e301f-53f5-484c-9871-46e7472509ba could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:07.460455 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cc7a527b-ef01-4265-9d64-75d3a5e01511 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba" status: 404 len: 111 microversion: 2.1 time: 0.031228 Jul 14 20:41:07.460455 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 392/775] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:07 2022] GET /compute/v2.1/servers/846e301f-53f5-484c-9871-46e7472509ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:08.400442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-da77fce2-ab1f-4768-b40e-99be0b974e73 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:08.401623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-da77fce2-ab1f-4768-b40e-99be0b974e73 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:08.408779 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da77fce2-ab1f-4768-b40e-99be0b974e73 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.409230 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da77fce2-ab1f-4768-b40e-99be0b974e73 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.410004 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da77fce2-ab1f-4768-b40e-99be0b974e73 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.410437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-da77fce2-ab1f-4768-b40e-99be0b974e73 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.434321 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-da77fce2-ab1f-4768-b40e-99be0b974e73 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/ips" status: 200 len: 145 microversion: 2.1 time: 0.037890 Jul 14 20:41:08.435147 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 384/776] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:41:08 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:08.594050 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:08.594526 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:08.601186 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.601641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.602403 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.602843 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.616027 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: DELETE /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee HTTP/1.1 Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:08.617559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.619169 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'f580e757-6a64-44b4-924f-3710d64601ee'} Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:08.619889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.622639 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:08.622639 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-028b78b0-1bcb-4881-99c9-1e151e01978f tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 404 len: 111 microversion: 2.1 time: 0.029336 Jul 14 20:41:08.622639 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 393/777] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:41:08 2022] DELETE /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:08.627443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:08.628059 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: f580e757-6a64-44b4-924f-3710d64601ee] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:08.634549 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.635028 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.635810 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.636252 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.651281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee HTTP/1.1 Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:08.653347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.654896 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'f580e757-6a64-44b4-924f-3710d64601ee'} Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:08.655835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. Jul 14 20:41:08.657588 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.658817 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance f580e757-6a64-44b4-924f-3710d64601ee could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:08.658817 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0ebc197e-fb6c-439c-8f7d-3c2b5805c1d8 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee" status: 404 len: 111 microversion: 2.1 time: 0.031164 Jul 14 20:41:08.658817 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 385/778] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:08 2022] GET /compute/v2.1/servers/f580e757-6a64-44b4-924f-3710d64601ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:41:08.663604 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:08.664103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:08.670523 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.670523 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.671343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.671778 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.686227 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: DELETE /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 HTTP/1.1 Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:08.687814 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.689295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '78c76d46-a8ea-4bcd-91b5-d12a4bfd7522'} Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:08.690105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.691317 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.692498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:08.692498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-172e4a0e-5b3c-4df4-8ec8-39efcfe2b9b0 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 404 len: 111 microversion: 2.1 time: 0.029468 Jul 14 20:41:08.692498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 394/779] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:41:08 2022] DELETE /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:08.697644 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:08.698231 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:08.705049 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.705474 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.706234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:08.706669 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:08.721077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 HTTP/1.1 Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:08.722589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.724282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '78c76d46-a8ea-4bcd-91b5-d12a4bfd7522'} Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:08.725170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. Jul 14 20:41:08.726589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:08.728099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:08.728099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1af2b04e-7756-4234-a8c8-ed18342bc296 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522" status: 404 len: 111 microversion: 2.1 time: 0.030166 Jul 14 20:41:08.728099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 386/780] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:08 2022] GET /compute/v2.1/servers/78c76d46-a8ea-4bcd-91b5-d12a4bfd7522 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:09.855264 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:09.856270 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:09.862967 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:09.863417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:09.864180 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:09.864707 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:09.879478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: DELETE /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 HTTP/1.1 Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:09.881017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.882549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '0ad8c60a-cc83-4ab7-beab-7c1a2b31c830'} Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:09.883458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.884723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.885908 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:09.885908 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-18316e05-eb99-4247-8402-f239dd10e479 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 404 len: 111 microversion: 2.1 time: 0.030948 Jul 14 20:41:09.885908 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 395/781] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:41:09 2022] DELETE /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:09.891057 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:09.891687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] [instance: 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:09.898345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:09.898787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:09.899575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:09.900009 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:09.914198 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] HTTP exception thrown: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Request method failure captured: Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 HTTP/1.1 Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3rxbax2IgEGoXFcz9dDTHaYizLM9O3LJkemNhcvsn2XIMnn39PTlTAqe0207ZQtpY5x4j7JSlRpl2PGa8_sjV1pQet0fdxEVcEaCg1TeR932RP-vY-bzagMT5q0saddJTTqhWaOZbVjEL_d8nT9CyyoJ-1Y6jZ1mbfAPgon2IUbDQ Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:09.915724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40baf66113cf4fb186ddd5e954a9b7a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40baf66113cf4fb186ddd5e954a9b7a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 40baf66113cf4fb186ddd5e954a9b7a4 Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013900926 Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 16c6975c73954487a1f15649693b1d8a Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeNegativeTest-1013900926-project Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.917310 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '0ad8c60a-cc83-4ab7-beab-7c1a2b31c830'} Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:09.918094 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. Jul 14 20:41:09.919868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:09.920976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] Returning 404 to user: Instance 0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:09.920976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e07d9d9e-e3bd-4ff6-b8a2-9def30931018 tempest-AttachVolumeNegativeTest-1013900926 tempest-AttachVolumeNegativeTest-1013900926-project] 10.222.0.52 "GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830" status: 404 len: 111 microversion: 2.1 time: 0.029996 Jul 14 20:41:09.920976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 387/782] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:09 2022] GET /compute/v2.1/servers/0ad8c60a-cc83-4ab7-beab-7c1a2b31c830 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:11.807311 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5f60cdb3-5f13-482a-acaa-cbefde9e9d4d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d9c769d-0e1a-40d2-952c-3a49e39c3826"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:11.809036 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5f60cdb3-5f13-482a-acaa-cbefde9e9d4d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:11.819005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5f60cdb3-5f13-482a-acaa-cbefde9e9d4d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:11.819651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5f60cdb3-5f13-482a-acaa-cbefde9e9d4d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:11.820960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5f60cdb3-5f13-482a-acaa-cbefde9e9d4d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:11.821404 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5f60cdb3-5f13-482a-acaa-cbefde9e9d4d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:12.127066 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5f60cdb3-5f13-482a-acaa-cbefde9e9d4d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322175 Jul 14 20:41:12.127855 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 396/783] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:41:11 2022] POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:14.591833 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ffa9b6b0-400b-4c53-891f-2d6a03112734 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Action: 'create', calling method: .version_select at 0x7fafb1843310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-620494844", "metadata": {"Type": "work"}}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:14.900907 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ffa9b6b0-400b-4c53-891f-2d6a03112734 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.434807 Jul 14 20:41:14.901824 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 388/784] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 14 20:41:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 20:41:14.914223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4c11682d-989e-430c-ab9d-ce973a537152 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Calling method '.version_select at 0x7fafb191e280>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:14.974117 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4c11682d-989e-430c-ab9d-ce973a537152 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86" status: 200 len: 352 microversion: 2.1 time: 0.064066 Jul 14 20:41:14.974799 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 397/785] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:14 2022] GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:15.987585 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ce60cfb6-7184-47a7-a1b5-1fad5bbcf155 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Calling method '.version_select at 0x7fafb187b8b0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:16.035888 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ce60cfb6-7184-47a7-a1b5-1fad5bbcf155 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86" status: 200 len: 353 microversion: 2.1 time: 0.052561 Jul 14 20:41:16.036473 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 389/786] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:15 2022] GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:16.049606 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-469f9da1-aa6a-4527-8d57-67ead16219e2 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Calling method '.version_select at 0x7fafb1b844c0>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:16.098295 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-469f9da1-aa6a-4527-8d57-67ead16219e2 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86" status: 200 len: 353 microversion: 2.1 time: 0.053131 Jul 14 20:41:16.098871 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 398/787] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:16 2022] GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:16.111168 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1b26da6c-0f17-496c-979d-fd9c3f6a5727 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Calling method '.version_select at 0x7fafb1978b80>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:16.174430 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1b26da6c-0f17-496c-979d-fd9c3f6a5727 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86" status: 202 len: 0 microversion: 2.1 time: 0.067482 Jul 14 20:41:16.175059 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 390/788] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:41:16 2022] DELETE /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 20:41:16.183259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2a9e2a49-0490-42d7-ae51-a16c838d5cfe tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Calling method '.version_select at 0x7fafb18a4af0>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:16.234577 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2a9e2a49-0490-42d7-ae51-a16c838d5cfe tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86" status: 200 len: 352 microversion: 2.1 time: 0.055264 Jul 14 20:41:16.235280 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 399/789] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:16 2022] GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:17.248580 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e5f5447d-025a-435d-9f9a-b90b48826b66 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Calling method '.version_select at 0x7fafb17b1e50>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:17.275254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-e5f5447d-025a-435d-9f9a-b90b48826b66 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] HTTP exception thrown: Volume facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 could not be found. Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e5f5447d-025a-435d-9f9a-b90b48826b66 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Request method failure captured: Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 HTTP/1.1 Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H9qWuqCdoewW8iEUwQyvcOyzI07GJtZMCnNjnuDSINrexReZ1BSNLAvAjzQ5-Z9G9lnbb9vGHMLmp-0_NWAHmhUojXq7hoGiId1P_cJfumO2PngvBJFcKkuBlnaTK_--bJs4tRpNpfw1tnLWmdlz2IeEyNb2RDKDmDP2bx6pxQ5Y2g Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: e6c03c3aff534d7d8b73d3199d925c09 Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesGetTestJSON-961414081 Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:17.279127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6c03c3aff534d7d8b73d3199d925c09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6c03c3aff534d7d8b73d3199d925c09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6c03c3aff534d7d8b73d3199d925c09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6c03c3aff534d7d8b73d3199d925c09", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesGetTestJSON-961414081 Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: e6c03c3aff534d7d8b73d3199d925c09 Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesGetTestJSON-961414081 Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesGetTestJSON-961414081-project Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 1a43aecd3f964e51add35244d3d88a19 Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesGetTestJSON-961414081-project Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Volume facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 could not be found. Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'facfacd3-0cf1-4ca4-a396-9b1efd6e6d86'} Jul 14 20:41:17.280804 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 could not be found. (HTTP 404) (Request-ID: req-51ceb3a1-b819-4b83-bc20-c3af66544543) Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:17.281739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:41:17.283232 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 could not be found. Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 20:41:17.284578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 could not be found. Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 could not be found. Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e5f5447d-025a-435d-9f9a-b90b48826b66 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] Returning 404 to user: Volume facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e5f5447d-025a-435d-9f9a-b90b48826b66 tempest-VolumesGetTestJSON-961414081 tempest-VolumesGetTestJSON-961414081-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86" status: 404 len: 109 microversion: 2.1 time: 0.036514 Jul 14 20:41:17.285952 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 391/790] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:17 2022] GET /compute/v2.1/os-volumes/facfacd3-0cf1-4ca4-a396-9b1efd6e6d86 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:18.700111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-783915d8-8d4e-4388-b65a-9d4be4227726 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Action: 'create', calling method: .version_select at 0x7fafb191e820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-613701231", "metadata": {"Type": "work"}}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-783915d8-8d4e-4388-b65a-9d4be4227726 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Request method failure captured: Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 121 Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H9uUqvpgPK3uAQUiAv55lL4_93dUb9SAUB7nzZ7-ICpgKMa9KXiEn21-GIfXpxtL5igrbLAZh4KOFOymhAxx2ryTvqqh1O0sPYGQOlD2fluKBKMdLLDl6_HurLaeoZscbjcNraTzepo57gufgeQ2IQgOiboCNFs0GQPw0Gf03szUlU Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:18.723728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9dc06ac7a2c7403faa7b384ff27c97d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: f1dc40fef49a43eb8e54fea4723f53fd Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-613701231", "metadata": {"Type": "work"}}} Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: Jul 14 20:41:18.725111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-613701231', 'metadata': {'Type': 'work'}}}} Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise error Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:18.725972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 20:41:18.727583 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 20:41:18.729005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 20:41:18.729005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.729005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-783915d8-8d4e-4388-b65a-9d4be4227726 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:18.729005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-783915d8-8d4e-4388-b65a-9d4be4227726 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142099 Jul 14 20:41:18.729005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 400/791] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 14 20:41:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:18.735393 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bcb779d5-7200-46a6-bc60-48ed57e089a0 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Action: 'create', calling method: .version_select at 0x7fafb1964310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1399192623", "metadata": {"Type": "work"}}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bcb779d5-7200-46a6-bc60-48ed57e089a0 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Request method failure captured: Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 120 Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H9uUqvpgPK3uAQUiAv55lL4_93dUb9SAUB7nzZ7-ICpgKMa9KXiEn21-GIfXpxtL5igrbLAZh4KOFOymhAxx2ryTvqqh1O0sPYGQOlD2fluKBKMdLLDl6_HurLaeoZscbjcNraTzepo57gufgeQ2IQgOiboCNFs0GQPw0Gf03szUlU Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:18.739235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9dc06ac7a2c7403faa7b384ff27c97d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: f1dc40fef49a43eb8e54fea4723f53fd Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1399192623", "metadata": {"Type": "work"}}} Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: Jul 14 20:41:18.740830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1399192623', 'metadata': {'Type': 'work'}}}} Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise error Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi '0' Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:18.742038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 20:41:18.743959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 20:41:18.745566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 20:41:18.745566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.745566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-bcb779d5-7200-46a6-bc60-48ed57e089a0 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:18.745566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-bcb779d5-7200-46a6-bc60-48ed57e089a0 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009667 Jul 14 20:41:18.745566 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 392/792] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 14 20:41:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:18.750377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-442decdb-8a86-43ec-9517-e5d8f9b04ce2 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Action: 'create', calling method: .version_select at 0x7fafb18a4ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2080878242", "metadata": {"Type": "work"}}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-442decdb-8a86-43ec-9517-e5d8f9b04ce2 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Request method failure captured: Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 119 Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H9uUqvpgPK3uAQUiAv55lL4_93dUb9SAUB7nzZ7-ICpgKMa9KXiEn21-GIfXpxtL5igrbLAZh4KOFOymhAxx2ryTvqqh1O0sPYGQOlD2fluKBKMdLLDl6_HurLaeoZscbjcNraTzepo57gufgeQ2IQgOiboCNFs0GQPw0Gf03szUlU Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:18.752835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9dc06ac7a2c7403faa7b384ff27c97d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: f1dc40fef49a43eb8e54fea4723f53fd Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2080878242", "metadata": {"Type": "work"}}} Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: Jul 14 20:41:18.754369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2080878242', 'metadata': {'Type': 'work'}}}} Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise error Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi '' Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:18.755366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 20:41:18.757162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 20:41:18.758628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 20:41:18.758628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.758628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-442decdb-8a86-43ec-9517-e5d8f9b04ce2 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:18.758628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-442decdb-8a86-43ec-9517-e5d8f9b04ce2 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008217 Jul 14 20:41:18.758628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 401/793] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 14 20:41:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:18.764011 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3d6bbd98-6fa7-454f-bb91-2b934ce448ad tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Calling method '.version_select at 0x7fafb17e6700>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:18.792815 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-3d6bbd98-6fa7-454f-bb91-2b934ce448ad tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] HTTP exception thrown: Volume tempest-invalid-1496754677 could not be found. Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3d6bbd98-6fa7-454f-bb91-2b934ce448ad tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Request method failure captured: Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1496754677 HTTP/1.1 Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H9uUqvpgPK3uAQUiAv55lL4_93dUb9SAUB7nzZ7-ICpgKMa9KXiEn21-GIfXpxtL5igrbLAZh4KOFOymhAxx2ryTvqqh1O0sPYGQOlD2fluKBKMdLLDl6_HurLaeoZscbjcNraTzepo57gufgeQ2IQgOiboCNFs0GQPw0Gf03szUlU Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:18.794962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9dc06ac7a2c7403faa7b384ff27c97d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: f1dc40fef49a43eb8e54fea4723f53fd Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Volume tempest-invalid-1496754677 could not be found. Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'tempest-invalid-1496754677'} Jul 14 20:41:18.796590 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1496754677 could not be found. (HTTP 404) (Request-ID: req-2d598539-c769-4840-b859-6005928bba98) Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.797575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 20:41:18.799020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1496754677 could not be found. Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:18.800400 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1496754677 could not be found. Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1496754677 could not be found. Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3d6bbd98-6fa7-454f-bb91-2b934ce448ad tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Returning 404 to user: Volume tempest-invalid-1496754677 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3d6bbd98-6fa7-454f-bb91-2b934ce448ad tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1496754677" status: 404 len: 99 microversion: 2.1 time: 0.036667 Jul 14 20:41:18.801850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 393/794] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Jul 14 20:41:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1496754677 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 20:41:18.808483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5dda6fdb-cdd0-4940-9961-d289b620b0b4 tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004443 Jul 14 20:41:18.809531 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 402/795] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Jul 14 20:41:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 20:41:18.818123 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-04aa9d75-2f13-4b53-a0a3-7cac25600aff tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003759 Jul 14 20:41:18.818615 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 394/796] 10.222.0.52 () {58 vars in 1136 bytes} [Thu Jul 14 20:41:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 20:41:18.827543 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81e57d02-0cf7-44ec-b832-2144a1a4175c tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Calling method '.version_select at 0x7fafb191e310>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:18.854444 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-81e57d02-0cf7-44ec-b832-2144a1a4175c tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] HTTP exception thrown: Volume 2a2a42cd-3a18-4978-9927-8b200c825aa9 could not be found. Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81e57d02-0cf7-44ec-b832-2144a1a4175c tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Request method failure captured: Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: DELETE /compute/v2.1/os-volumes/2a2a42cd-3a18-4978-9927-8b200c825aa9 HTTP/1.1 Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H9uUqvpgPK3uAQUiAv55lL4_93dUb9SAUB7nzZ7-ICpgKMa9KXiEn21-GIfXpxtL5igrbLAZh4KOFOymhAxx2ryTvqqh1O0sPYGQOlD2fluKBKMdLLDl6_HurLaeoZscbjcNraTzepo57gufgeQ2IQgOiboCNFs0GQPw0Gf03szUlU Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:18.858325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9dc06ac7a2c7403faa7b384ff27c97d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: f1dc40fef49a43eb8e54fea4723f53fd Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Volume 2a2a42cd-3a18-4978-9927-8b200c825aa9 could not be found. Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '2a2a42cd-3a18-4978-9927-8b200c825aa9'} Jul 14 20:41:18.859978 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a2a42cd-3a18-4978-9927-8b200c825aa9 could not be found. (HTTP 404) (Request-ID: req-8a714318-2635-472b-b131-90e96b15875e) Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.860948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 20:41:18.862333 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a2a42cd-3a18-4978-9927-8b200c825aa9 could not be found. Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 20:41:18.864831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a2a42cd-3a18-4978-9927-8b200c825aa9 could not be found. Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a2a42cd-3a18-4978-9927-8b200c825aa9 could not be found. Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81e57d02-0cf7-44ec-b832-2144a1a4175c tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Returning 404 to user: Volume 2a2a42cd-3a18-4978-9927-8b200c825aa9 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-81e57d02-0cf7-44ec-b832-2144a1a4175c tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/2a2a42cd-3a18-4978-9927-8b200c825aa9" status: 404 len: 109 microversion: 2.1 time: 0.036584 Jul 14 20:41:18.866216 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 403/797] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:41:18 2022] DELETE /compute/v2.1/os-volumes/2a2a42cd-3a18-4978-9927-8b200c825aa9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:41:18.869939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2ac03434-44a2-4ce3-a7bb-b44c57f0902d tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Calling method '.version_select at 0x7fafb17b1e50>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:18.898725 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-2ac03434-44a2-4ce3-a7bb-b44c57f0902d tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] HTTP exception thrown: Volume 1aab4041-93f0-4c47-8344-db19739ab917 could not be found. Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2ac03434-44a2-4ce3-a7bb-b44c57f0902d tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Request method failure captured: Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/os-volumes/1aab4041-93f0-4c47-8344-db19739ab917 HTTP/1.1 Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H9uUqvpgPK3uAQUiAv55lL4_93dUb9SAUB7nzZ7-ICpgKMa9KXiEn21-GIfXpxtL5igrbLAZh4KOFOymhAxx2ryTvqqh1O0sPYGQOlD2fluKBKMdLLDl6_HurLaeoZscbjcNraTzepo57gufgeQ2IQgOiboCNFs0GQPw0Gf03szUlU Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:18.900740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9dc06ac7a2c7403faa7b384ff27c97d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9dc06ac7a2c7403faa7b384ff27c97d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 9dc06ac7a2c7403faa7b384ff27c97d7 Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesNegativeTest-1902563030 Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: f1dc40fef49a43eb8e54fea4723f53fd Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesNegativeTest-1902563030-project Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Volume 1aab4041-93f0-4c47-8344-db19739ab917 could not be found. Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '1aab4041-93f0-4c47-8344-db19739ab917'} Jul 14 20:41:18.902299 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1aab4041-93f0-4c47-8344-db19739ab917 could not be found. (HTTP 404) (Request-ID: req-a8be2c1d-b7c2-421a-9d5c-9c9ad8a00b9c) Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.903985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:41:18.905194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1aab4041-93f0-4c47-8344-db19739ab917 could not be found. Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 20:41:18.906462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1aab4041-93f0-4c47-8344-db19739ab917 could not be found. Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1aab4041-93f0-4c47-8344-db19739ab917 could not be found. Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2ac03434-44a2-4ce3-a7bb-b44c57f0902d tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] Returning 404 to user: Volume 1aab4041-93f0-4c47-8344-db19739ab917 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2ac03434-44a2-4ce3-a7bb-b44c57f0902d tempest-VolumesNegativeTest-1902563030 tempest-VolumesNegativeTest-1902563030-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1aab4041-93f0-4c47-8344-db19739ab917" status: 404 len: 109 microversion: 2.1 time: 0.036728 Jul 14 20:41:18.907698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 395/798] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:18 2022] GET /compute/v2.1/os-volumes/1aab4041-93f0-4c47-8344-db19739ab917 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:19.686144 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-bab08447-31e0-41c4-9151-50f50dfd5270 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:19.695178 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bab08447-31e0-41c4-9151-50f50dfd5270 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:19.695629 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bab08447-31e0-41c4-9151-50f50dfd5270 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:19.757471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-bab08447-31e0-41c4-9151-50f50dfd5270 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Going to try to stop instance {{(pid=124370) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 20:41:19.803913 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-bab08447-31e0-41c4-9151-50f50dfd5270 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action" status: 202 len: 0 microversion: 2.1 time: 0.121920 Jul 14 20:41:19.804518 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 404/799] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:41:19 2022] POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:41:19.814220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:19.814830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:19.816795 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=32 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:19.823955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:19.825156 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:19.826742 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:19.827393 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:19.975060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:19.983872 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1496705c-fd7d-494e-a070-21338d41f30f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.174254 Jul 14 20:41:19.984448 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 396/800] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:19 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:21.007022 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:21.007749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:21.014140 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:21.014595 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:21.015403 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:21.015846 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:21.164782 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:21.173750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-076129a6-0b9d-4d87-b8ab-c730463fd56e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.174466 Jul 14 20:41:21.174335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 405/801] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:20 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:22.190614 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:22.191226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:22.197882 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:22.198329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:22.199658 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:22.200099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:22.340053 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:22.347863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8cd2662d-d63d-44b4-a632-21b147c3c45e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.161106 Jul 14 20:41:22.348425 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 397/802] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:22 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:23.365302 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:23.365903 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:23.373313 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:23.373761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:23.374526 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:23.374986 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:23.508839 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:23.517878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5a06ee2e-9352-40be-9e51-fc0a52d2eceb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.156481 Jul 14 20:41:23.518446 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 406/803] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:23 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:24.535898 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:24.536499 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:24.544170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:24.544719 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:24.545502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:24.546018 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:24.684913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:24.693388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0bf4ad11-57a4-400c-87d2-88323ca6b2de tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.161482 Jul 14 20:41:24.693948 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 398/804] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:24 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:25.709653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:25.710241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:25.717459 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:25.717912 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:25.718731 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:25.719203 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:25.852005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:25.860204 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a6f0de1a-5711-4738-b8d0-0230e9466956 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.154429 Jul 14 20:41:25.860796 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 407/805] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:25 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:26.877554 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:26.878145 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:26.884955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:26.885396 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:26.886174 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:26.886607 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:27.019625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:27.028885 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-74292f30-1b7f-47d5-9696-6a8b6175d3e1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.155071 Jul 14 20:41:27.029460 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 399/806] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:26 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:28.045717 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:28.046326 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:28.053246 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:28.053690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:28.054479 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:28.054916 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:28.199787 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:28.208196 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-215e71cc-e5a9-475c-ab28-3be510a8075c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.166284 Jul 14 20:41:28.208765 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 408/807] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:28 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:29.225787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:29.226561 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:29.233192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:29.233644 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:29.234434 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:29.234863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:29.384604 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:29.392953 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fd74060e-07a0-491e-91fa-29b040c2de77 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.171081 Jul 14 20:41:29.393524 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 400/808] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:29 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:30.409553 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:30.410154 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:30.416860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:30.417318 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:30.418592 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:30.419059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:30.563914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:30.572289 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ec4e7881-c52d-4930-8319-2f8b48dd893b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.166507 Jul 14 20:41:30.572860 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 409/809] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:30 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:31.589207 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:31.590369 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:31.597298 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:31.597748 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:31.598518 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:31.598979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:31.745378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:31.753586 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5a2cbb77-1c2a-47c9-bb54-1956c2bc7a29 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.168238 Jul 14 20:41:31.754393 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 401/810] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:31 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:32.771653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:32.772515 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:32.779183 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:32.779848 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:32.780810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:32.781397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:32.784656 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=68,nova_cell1:UPDATE=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:32.922460 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:32.930859 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3511ea73-1832-4000-bcae-3a0da44b286a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.163284 Jul 14 20:41:32.931511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 410/811] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:32 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:41:33.947996 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:33.948558 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:33.954979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:33.955432 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:33.956286 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:33.956818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:34.088351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:34.096886 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e4a7e47f-9536-4428-9978-c37ee3b0294a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.152729 Jul 14 20:41:34.097565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 402/812] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:33 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:35.115018 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:35.115600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:35.118018 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:35.124820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:35.125268 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:35.126037 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:35.126470 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:35.257323 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:35.265464 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5d68ff27-6756-4cf3-8d01-64bcb23fc882 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.154284 Jul 14 20:41:35.266037 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 411/813] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:35 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:36.283476 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:36.284082 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:36.291063 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:36.291512 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:36.292290 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:36.292762 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:36.295680 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=62 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:36.711261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:36.720000 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c5bef319-ec34-42a3-94ff-7e9ab57550d3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.440309 Jul 14 20:41:36.720563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 403/814] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:36 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:36.756868 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1282505549"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:36.757439 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:36.764173 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:36.764622 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:36.765400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:36.765837 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:36.897218 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.network.security_group_api [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Removing security group 36c58622-2413-47b8-b171-0623dd201cb5 from port 987b5585-aa48-407d-914f-a635c3962008 Jul 14 20:41:37.246415 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e36cc5e7-5a65-48dc-a379-654574183d03 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/action" status: 202 len: 0 microversion: 2.1 time: 0.492725 Jul 14 20:41:37.249123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 412/815] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:41:36 2022] POST /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:41:37.272085 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-48c8b432-2505-4e6d-b869-58f487cdffce req-fea77b83-39bc-404f-99e8-100257e5ff01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152", "tag": "987b5585-aa48-407d-914f-a635c3962008"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:37.301117 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-48c8b432-2505-4e6d-b869-58f487cdffce req-fea77b83-39bc-404f-99e8-100257e5ff01 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:37.305405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-48c8b432-2505-4e6d-b869-58f487cdffce req-fea77b83-39bc-404f-99e8-100257e5ff01 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:37.325357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-48c8b432-2505-4e6d-b869-58f487cdffce req-fea77b83-39bc-404f-99e8-100257e5ff01 service nova] Creating event network-changed:987b5585-aa48-407d-914f-a635c3962008 for instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 on hv-cinder-79987 Jul 14 20:41:37.345125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-48c8b432-2505-4e6d-b869-58f487cdffce req-fea77b83-39bc-404f-99e8-100257e5ff01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089133 Jul 14 20:41:37.345743 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 404/816] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:37.742469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:37.743757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:37.754627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:37.755589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:37.756411 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:37.757730 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:37.974896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:37.984479 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f2cd72ce-08dd-426c-8869-d40eac14f4a2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.249098 Jul 14 20:41:37.984994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 413/817] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:37 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:38.431982 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:38.432613 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-03e2f448-3901-4b76-81ab-136a6baf7171 req-bed05c31-b715-4aef-8ea3-515b3335be19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152", "tag": "987b5585-aa48-407d-914f-a635c3962008"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:38.432733 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:38.442656 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-03e2f448-3901-4b76-81ab-136a6baf7171 req-bed05c31-b715-4aef-8ea3-515b3335be19 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:38.443297 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-03e2f448-3901-4b76-81ab-136a6baf7171 req-bed05c31-b715-4aef-8ea3-515b3335be19 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:38.445105 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:38.445570 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:38.446912 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:38.447563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:38.456613 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-03e2f448-3901-4b76-81ab-136a6baf7171 req-bed05c31-b715-4aef-8ea3-515b3335be19 service nova] Creating event network-changed:987b5585-aa48-407d-914f-a635c3962008 for instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 on hv-cinder-79987 Jul 14 20:41:38.462282 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-03e2f448-3901-4b76-81ab-136a6baf7171 req-bed05c31-b715-4aef-8ea3-515b3335be19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033784 Jul 14 20:41:38.463234 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 414/818] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:41:38.566167 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lazy-loading 'services' on Instance uuid 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:41:38.664565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ef595ec5-15cc-456d-a951-b2fd1b8df735 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "DELETE /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments/90288118-791d-4e85-ab79-449065769cb4" status: 202 len: 0 microversion: 2.1 time: 0.238060 Jul 14 20:41:38.669170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 405/819] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:41:38 2022] DELETE /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments/90288118-791d-4e85-ab79-449065769cb4 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:41:38.679387 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f7edf6d8-bb40-4a6f-b135-670195de2f32 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:38.681080 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f7edf6d8-bb40-4a6f-b135-670195de2f32 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:38.691249 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7edf6d8-bb40-4a6f-b135-670195de2f32 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:38.692111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7edf6d8-bb40-4a6f-b135-670195de2f32 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:38.693217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7edf6d8-bb40-4a6f-b135-670195de2f32 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:38.694070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7edf6d8-bb40-4a6f-b135-670195de2f32 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:38.738985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f7edf6d8-bb40-4a6f-b135-670195de2f32 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067706 Jul 14 20:41:38.740215 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 415/820] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:41:38 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:39.001319 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:39.002254 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:39.008935 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:39.009664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:39.010671 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:39.011351 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:39.168831 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:39.178899 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ae2deef8-59b9-491d-9ec5-d1d006b5dfe9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.181803 Jul 14 20:41:39.180472 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 406/821] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:38 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:39.756210 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81176c22-f8d6-4fa0-8dc0-2ac000f6beec tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:39.757170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-81176c22-f8d6-4fa0-8dc0-2ac000f6beec tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:39.772067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81176c22-f8d6-4fa0-8dc0-2ac000f6beec tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:39.772816 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81176c22-f8d6-4fa0-8dc0-2ac000f6beec tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:39.773835 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81176c22-f8d6-4fa0-8dc0-2ac000f6beec tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:39.774726 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81176c22-f8d6-4fa0-8dc0-2ac000f6beec tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:39.808230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-81176c22-f8d6-4fa0-8dc0-2ac000f6beec tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060259 Jul 14 20:41:39.808879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 416/822] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:41:39 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:40.199377 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:40.199895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:40.206336 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.207206 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.208208 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.208612 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.367753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:40.376360 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e4a237ab-a537-4c72-8a2b-c08cacc9aa58 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1721 microversion: 2.1 time: 0.182127 Jul 14 20:41:40.376931 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 407/823] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:40 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:40.664039 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-73b8b8e5-d8b7-411b-808a-c195d7c5c332 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:40.665325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-73b8b8e5-d8b7-411b-808a-c195d7c5c332 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:40.671937 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-73b8b8e5-d8b7-411b-808a-c195d7c5c332 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.672496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-73b8b8e5-d8b7-411b-808a-c195d7c5c332 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.673353 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-73b8b8e5-d8b7-411b-808a-c195d7c5c332 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.673795 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-73b8b8e5-d8b7-411b-808a-c195d7c5c332 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.715749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-73b8b8e5-d8b7-411b-808a-c195d7c5c332 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055676 Jul 14 20:41:40.716532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 417/824] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 14 20:41:40 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:40.780341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:40.781116 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:40.787642 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.788076 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.788845 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.789280 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.820436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5b43385b-53a0-4d3f-9a1f-cd4992079efe tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:40.822021 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5b43385b-53a0-4d3f-9a1f-cd4992079efe tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:40.822977 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:41:40.829406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5b43385b-53a0-4d3f-9a1f-cd4992079efe tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.830110 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5b43385b-53a0-4d3f-9a1f-cd4992079efe tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.831114 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5b43385b-53a0-4d3f-9a1f-cd4992079efe tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.831709 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5b43385b-53a0-4d3f-9a1f-cd4992079efe tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.862283 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5b43385b-53a0-4d3f-9a1f-cd4992079efe tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045857 Jul 14 20:41:40.867849 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 418/825] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:41:40 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 20:41:40.873836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:40.874327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:40.881068 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.881589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.882480 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.882957 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.918492 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d46a25ea-c8cd-406b-9bce-1e6296660903 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 204 len: 0 microversion: 2.20 time: 0.141369 Jul 14 20:41:40.919234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 408/826] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 14 20:41:40 2022] DELETE /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 20:41:40.929126 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:40.929842 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:40.937683 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.938212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:40.939034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:40.939471 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:41.001465 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] HTTP exception thrown: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 is not attached to volume 90288118-791d-4e85-ab79-449065769cb4 Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Request method failure captured: Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: DELETE /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments/90288118-791d-4e85-ab79-449065769cb4 HTTP/1.1 Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H7hyecpAw0tjmvdThLBhrUMMP5KGqBvcpe8dZjZrPTrxnGSif43o-IrkOHgbkWxFIukzqQ7f_-GWZKqA14dfrrvAc7eKWL4o-LWoRGZNVFDe9l47Kgu860iEN7mKcVNlxPtoNzujT48dA5L4FGamgUQVXxJIsmhXZYNIUsbP2Z6BDs Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 2df2b1715762427cb824e381a83bdad1 Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-TestMinimumBasicScenario-342498572 Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:41.003914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2df2b1715762427cb824e381a83bdad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2df2b1715762427cb824e381a83bdad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2df2b1715762427cb824e381a83bdad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2df2b1715762427cb824e381a83bdad1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-TestMinimumBasicScenario-342498572 Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 2df2b1715762427cb824e381a83bdad1 Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-TestMinimumBasicScenario-342498572 Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-TestMinimumBasicScenario-342498572-project Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 75744cbe26cb4635af3db596f3c235b5 Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-TestMinimumBasicScenario-342498572-project Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:41.006004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 is not attached to volume 90288118-791d-4e85-ab79-449065769cb4 Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'server_id': '80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152', 'id': '90288118-791d-4e85-ab79-449065769cb4'} Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 90288118-791d-4e85-ab79-449065769cb4. Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:41.007922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 is not attached to volume 90288118-791d-4e85-ab79-449065769cb4 Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 is not attached to volume 90288118-791d-4e85-ab79-449065769cb4 Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:41.013532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Returning 404 to user: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 is not attached to volume 90288118-791d-4e85-ab79-449065769cb4 {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:41.015868 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dac2f48c-8f0b-47ab-8ed6-2161b244e4dc tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "DELETE /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments/90288118-791d-4e85-ab79-449065769cb4" status: 404 len: 154 microversion: 2.1 time: 0.136226 Jul 14 20:41:41.015868 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 419/827] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:41:40 2022] DELETE /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152/os-volume_attachments/90288118-791d-4e85-ab79-449065769cb4 => generated 154 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:41:41.107862 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:41.118346 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:41.120017 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:41.121445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3271e682-2e45-46a4-925f-5db8d6c0abfe tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.197536 Jul 14 20:41:41.122003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 409/828] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:40 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 20:41:41.393696 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:41.394605 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:41.400695 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:41.401161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:41.402409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:41.402409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:41.539931 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:41.547914 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1c940c63-ee54-41e8-b89a-7bed9c368704 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1698 microversion: 2.1 time: 0.158244 Jul 14 20:41:41.548479 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 420/829] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:41 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:41.563932 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1ee915be-06ab-4fa0-a3e5-d35172af788b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:41.570029 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1ee915be-06ab-4fa0-a3e5-d35172af788b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:41.570480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1ee915be-06ab-4fa0-a3e5-d35172af788b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:41.629317 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1ee915be-06ab-4fa0-a3e5-d35172af788b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Going to try to start instance {{(pid=124371) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 20:41:41.674204 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1ee915be-06ab-4fa0-a3e5-d35172af788b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action" status: 202 len: 0 microversion: 2.1 time: 0.113827 Jul 14 20:41:41.674807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 410/830] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:41:41 2022] POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 20:41:41.683822 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:41.684437 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:41.690614 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:41.691115 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:41.691904 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:41.692676 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:41.845813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:41.857966 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-aa943e3e-2ff8-4d53-bffe-1117678aa424 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1707 microversion: 2.1 time: 0.178626 Jul 14 20:41:41.858539 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 421/831] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:41 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1707 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:42.142109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:42.142918 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:42.149953 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.150404 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:42.151214 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.152312 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:42.171840 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:42.172347 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:42.178502 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.178985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:42.179775 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.180217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:42.214659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:41:42.306246 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:42.315107 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:42.317562 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:42.319251 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ceb7911e-9907-4228-aab0-83c94420bc9d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.181841 Jul 14 20:41:42.319862 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 411/832] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:42 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:41:42.326892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-26b8daea-c982-45f9-9c39-6a1c1fb89449 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "DELETE /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 204 len: 0 microversion: 2.1 time: 0.158404 Jul 14 20:41:42.328061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 422/833] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:41:42 2022] DELETE /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:41:42.336629 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:42.337245 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:42.344498 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.344691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:42.345693 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.346227 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:42.484651 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:42.492234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0fe8657b-4ea0-46e0-8f9d-4a01bd1114da tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1553 microversion: 2.1 time: 0.159525 Jul 14 20:41:42.492830 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 412/834] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:42 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:42.876925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:42.877619 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:42.884463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.884913 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:42.886232 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:42.886685 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:43.021974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:43.030398 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a29caea4-44ea-454d-aa92-2736671be1b8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1707 microversion: 2.1 time: 0.157633 Jul 14 20:41:43.031080 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 423/835] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:42 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:43.340688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:43.341283 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:43.348816 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:43.349267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:43.350049 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:43.350488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:43.480695 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:43.488538 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:43.490024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:43.491201 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-214db7df-bb09-44ae-9c74-98f7fff9d26c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.155023 Jul 14 20:41:43.491756 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 413/836] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:43 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:41:43.509474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:43.510084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:43.516141 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:43.516600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:43.517363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:43.517800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:43.651356 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:43.659824 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-084fce0d-b7e3-43b8-a3d2-011c7f95a18f tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1553 microversion: 2.1 time: 0.154142 Jul 14 20:41:43.660404 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 424/837] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:43 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:44.049415 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:44.050155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:44.058073 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:44.058592 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:44.060785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:44.060785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:44.396097 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:44.409837 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-15abef9f-5470-4c4f-8f73-c563ccd8b56d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1707 microversion: 2.1 time: 0.364322 Jul 14 20:41:44.412269 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 414/838] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:44 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1707 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:44.509238 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:44.510589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:44.521352 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:44.522128 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:44.523448 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:44.526459 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:44.676753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:44.677527 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:44.685012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:44.685466 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:44.686261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:44.686701 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:44.892690 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75744cbe26cb4635af3db596f3c235b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df2b1715762427cb824e381a83bdad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:44.901809 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-41657136-d88d-4ce7-a9c2-27990bf05921 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 200 len: 1511 microversion: 2.1 time: 0.228777 Jul 14 20:41:44.902472 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 415/839] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:44 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:41:44.908938 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-c012e2c2-82d0-4f38-b748-073400edf683 req-3cf568f7-ad35-4fca-9d77-59dc1bf0ac03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152", "name": "network-vif-deleted", "tag": "987b5585-aa48-407d-914f-a635c3962008"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:44.918623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-c012e2c2-82d0-4f38-b748-073400edf683 req-3cf568f7-ad35-4fca-9d77-59dc1bf0ac03 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:44.919381 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-c012e2c2-82d0-4f38-b748-073400edf683 req-3cf568f7-ad35-4fca-9d77-59dc1bf0ac03 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:44.934255 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-c012e2c2-82d0-4f38-b748-073400edf683 req-3cf568f7-ad35-4fca-9d77-59dc1bf0ac03 service nova] Creating event network-vif-deleted:987b5585-aa48-407d-914f-a635c3962008 for instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 on hv-cinder-79987 Jul 14 20:41:44.940670 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-c012e2c2-82d0-4f38-b748-073400edf683 req-3cf568f7-ad35-4fca-9d77-59dc1bf0ac03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036281 Jul 14 20:41:44.942120 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 416/840] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:45.071516 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:45.081234 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:45.082678 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:45.083928 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8034c5cf-6c08-415e-b27c-f15644979897 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1723 microversion: 2.20 time: 0.578699 Jul 14 20:41:45.084602 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 425/841] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:44 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1723 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:41:45.429756 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:45.430476 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:45.438228 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:45.438684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:45.439556 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:45.439995 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:45.737965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:45.740625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:45.748207 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c8191979-fd59-4d4e-a0a7-7d63dfe69b3f tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1707 microversion: 2.1 time: 0.323979 Jul 14 20:41:45.758353 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 417/842] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:45 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1707 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:41:45.920625 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:45.921515 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] [instance: 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:45.939553 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:45.940400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:45.941367 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:45.942023 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:45.970527 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:45.972714 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] HTTP exception thrown: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 could not be found. Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Request method failure captured: Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 HTTP/1.1 Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H7hyecpAw0tjmvdThLBhrUMMP5KGqBvcpe8dZjZrPTrxnGSif43o-IrkOHgbkWxFIukzqQ7f_-GWZKqA14dfrrvAc7eKWL4o-LWoRGZNVFDe9l47Kgu860iEN7mKcVNlxPtoNzujT48dA5L4FGamgUQVXxJIsmhXZYNIUsbP2Z6BDs Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 2df2b1715762427cb824e381a83bdad1 Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-TestMinimumBasicScenario-342498572 Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:45.975230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2df2b1715762427cb824e381a83bdad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2df2b1715762427cb824e381a83bdad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2df2b1715762427cb824e381a83bdad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2df2b1715762427cb824e381a83bdad1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-TestMinimumBasicScenario-342498572 Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 2df2b1715762427cb824e381a83bdad1 Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-TestMinimumBasicScenario-342498572 Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-TestMinimumBasicScenario-342498572-project Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 75744cbe26cb4635af3db596f3c235b5 Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-TestMinimumBasicScenario-342498572-project Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 could not be found. Jul 14 20:41:45.976659 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152'} Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 could not be found. Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:45.977529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 could not be found. Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 could not be found. Jul 14 20:41:45.978819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:45.982303 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Returning 404 to user: Instance 80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:45.983513 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-310e7aad-942a-47b0-817d-71e0d0295461 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152" status: 404 len: 111 microversion: 2.1 time: 0.067550 Jul 14 20:41:45.984725 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 426/843] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:45 2022] GET /compute/v2.1/servers/80f0c372-4d8f-4d6d-b0e2-6a36a7aaa152 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:41:45.992953 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-47ee8adf-bc4e-412b-9348-4ab680b20fe8 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] Calling method '.version_select at 0x7fafb183b550>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:46.022629 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-47ee8adf-bc4e-412b-9348-4ab680b20fe8 tempest-TestMinimumBasicScenario-342498572 tempest-TestMinimumBasicScenario-342498572-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-348375845" status: 202 len: 0 microversion: 2.1 time: 0.033513 Jul 14 20:41:46.023591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 418/844] 10.222.0.52 () {58 vars in 1268 bytes} [Thu Jul 14 20:41:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-348375845 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:41:46.105447 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:46.106487 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:46.117416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:46.118777 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:46.120600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:46.121254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:46.233457 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:46.246106 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:46.250032 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cf43634335a428093ee30c2dd99187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d67813ac3a41d6a7b7ae8ac9629d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:46.251400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3a294e19-e3b8-401a-bed9-6dc24d14f79c tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 200 len: 1655 microversion: 2.20 time: 0.153086 Jul 14 20:41:46.255403 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 427/845] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:46 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 20:41:46.308963 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-6b9fb6f3-4d9a-43ee-a83d-68808fac3d05 req-763c0c85-0e67-4761-b545-5b39fa62107e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea90cac-431b-48d8-8171-944bd150754f", "name": "network-vif-deleted", "tag": "a450ed13-0148-4da1-9b7d-201016068164"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:46.329582 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-6b9fb6f3-4d9a-43ee-a83d-68808fac3d05 req-763c0c85-0e67-4761-b545-5b39fa62107e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:46.330862 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-6b9fb6f3-4d9a-43ee-a83d-68808fac3d05 req-763c0c85-0e67-4761-b545-5b39fa62107e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:46.388563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-6b9fb6f3-4d9a-43ee-a83d-68808fac3d05 req-763c0c85-0e67-4761-b545-5b39fa62107e service nova] Creating event network-vif-deleted:a450ed13-0148-4da1-9b7d-201016068164 for instance 8ea90cac-431b-48d8-8171-944bd150754f on hv-cinder-79987 Jul 14 20:41:46.404571 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-6b9fb6f3-4d9a-43ee-a83d-68808fac3d05 req-763c0c85-0e67-4761-b545-5b39fa62107e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105488 Jul 14 20:41:46.408453 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 419/846] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:46.766915 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:46.767819 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:46.775220 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:46.775678 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:46.777362 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:46.777811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:46.932603 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:41:46.945923 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6660cbd9-33b5-4bac-baca-0b7dcc321a90 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1711 microversion: 2.1 time: 0.182575 Jul 14 20:41:46.948790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 428/847] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:41:46 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1711 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:41:47.281684 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:47.283038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:47.291894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:47.292349 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:47.293358 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:47.293807 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:47.311352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] HTTP exception thrown: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Request method failure captured: Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f HTTP/1.1 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3hs4lfnds1lVIH6oNqG9OJgfeQyRkR8aVEQuZLkik3sZgAKztWX0F9CkXYY_xJDX7dajxlvYUGF8otuO6a6FEBUlSmOn8t1HsVbP6gJRsxSgLVpr1OFg-f9Wx92X4dRhxYKuxqmBkmfxXybEq0M74JsveJ5aGwXyvpnV8p-HD4_08 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:47.313093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8d67813ac3a41d6a7b7ae8ac9629d71", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 5cf43634335a428093ee30c2dd99187b Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:47.319854 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '8ea90cac-431b-48d8-8171-944bd150754f'} Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:47.321532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:47.325335 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:47.327802 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Returning 404 to user: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:47.327802 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9dc3b332-de69-40d4-9b04-1e1e0659aa00 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 404 len: 111 microversion: 2.20 time: 0.041788 Jul 14 20:41:47.327802 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 420/848] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:47 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:47.330381 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-23d8a238-ba07-48ee-808f-56b8edfa1e1d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '.version_select at 0x7fafb18ac820>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:47.357140 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-23d8a238-ba07-48ee-808f-56b8edfa1e1d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868786529" status: 204 len: 0 microversion: 2.20 time: 0.035301 Jul 14 20:41:47.358301 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 429/849] 10.222.0.52 () {60 vars in 1258 bytes} [Thu Jul 14 20:41:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868786529 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 20:41:49.322128 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:49.324051 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:49.330749 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:49.331303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:49.332174 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:49.332787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:49.348235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] HTTP exception thrown: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Request method failure captured: Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f HTTP/1.1 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3hs4lfnds1lVIH6oNqG9OJgfeQyRkR8aVEQuZLkik3sZgAKztWX0F9CkXYY_xJDX7dajxlvYUGF8otuO6a6FEBUlSmOn8t1HsVbP6gJRsxSgLVpr1OFg-f9Wx92X4dRhxYKuxqmBkmfxXybEq0M74JsveJ5aGwXyvpnV8p-HD4_08 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:49.350074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8d67813ac3a41d6a7b7ae8ac9629d71", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 5cf43634335a428093ee30c2dd99187b Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.352036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '8ea90cac-431b-48d8-8171-944bd150754f'} Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:49.352843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.354070 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.355345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Returning 404 to user: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:49.355345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-847d721a-ecd0-4db2-b415-ce0593faaf3e tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 404 len: 111 microversion: 2.20 time: 0.034178 Jul 14 20:41:49.355345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 421/850] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 14 20:41:49 2022] DELETE /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:49.360756 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:49.361559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: 8ea90cac-431b-48d8-8171-944bd150754f] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:49.368163 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:49.368613 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:49.369392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:49.369829 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:49.383743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] HTTP exception thrown: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Request method failure captured: Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f HTTP/1.1 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3hs4lfnds1lVIH6oNqG9OJgfeQyRkR8aVEQuZLkik3sZgAKztWX0F9CkXYY_xJDX7dajxlvYUGF8otuO6a6FEBUlSmOn8t1HsVbP6gJRsxSgLVpr1OFg-f9Wx92X4dRhxYKuxqmBkmfxXybEq0M74JsveJ5aGwXyvpnV8p-HD4_08 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:49.385288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8d67813ac3a41d6a7b7ae8ac9629d71", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 5cf43634335a428093ee30c2dd99187b Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.387657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '8ea90cac-431b-48d8-8171-944bd150754f'} Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:49.388499 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. Jul 14 20:41:49.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:49.390894 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Returning 404 to user: Instance 8ea90cac-431b-48d8-8171-944bd150754f could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:49.390894 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0e8ef09c-d620-4a7b-a1e2-3c47ddc051f4 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f" status: 404 len: 111 microversion: 2.20 time: 0.030936 Jul 14 20:41:49.390894 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 430/851] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:49 2022] GET /compute/v2.1/servers/8ea90cac-431b-48d8-8171-944bd150754f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:50.543837 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:50.544340 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:50.549756 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:41:50.551758 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:50.552210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:50.552999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:50.553577 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:50.571478 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] HTTP exception thrown: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Request method failure captured: Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc HTTP/1.1 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H3hs4lfnds1lVIH6oNqG9OJgfeQyRkR8aVEQuZLkik3sZgAKztWX0F9CkXYY_xJDX7dajxlvYUGF8otuO6a6FEBUlSmOn8t1HsVbP6gJRsxSgLVpr1OFg-f9Wx92X4dRhxYKuxqmBkmfxXybEq0M74JsveJ5aGwXyvpnV8p-HD4_08 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:41:50.572688 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8d67813ac3a41d6a7b7ae8ac9629d71", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 5cf43634335a428093ee30c2dd99187b Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.574856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'e306d8c2-449e-43db-8e98-53d049726ddc'} Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:50.576015 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.577533 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.578993 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Returning 404 to user: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:50.578993 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f51b6257-5ab1-48f6-a4da-bfbb73d1c6d0 tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 404 len: 111 microversion: 2.20 time: 0.038028 Jul 14 20:41:50.578993 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 422/852] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 14 20:41:50 2022] DELETE /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:50.583126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:50.583765 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] [instance: e306d8c2-449e-43db-8e98-53d049726ddc] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:41:50.590369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:50.590823 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:50.591672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:41:50.592113 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:41:50.606958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] HTTP exception thrown: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Request method failure captured: Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc HTTP/1.1 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H3hs4lfnds1lVIH6oNqG9OJgfeQyRkR8aVEQuZLkik3sZgAKztWX0F9CkXYY_xJDX7dajxlvYUGF8otuO6a6FEBUlSmOn8t1HsVbP6gJRsxSgLVpr1OFg-f9Wx92X4dRhxYKuxqmBkmfxXybEq0M74JsveJ5aGwXyvpnV8p-HD4_08 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:41:50.613162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8d67813ac3a41d6a7b7ae8ac9629d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8d67813ac3a41d6a7b7ae8ac9629d71", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: d8d67813ac3a41d6a7b7ae8ac9629d71 Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1379355146 Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 5cf43634335a428093ee30c2dd99187b Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1379355146-project Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.614693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'e306d8c2-449e-43db-8e98-53d049726ddc'} Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:41:50.615475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. Jul 14 20:41:50.616887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:41:50.618201 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] Returning 404 to user: Instance e306d8c2-449e-43db-8e98-53d049726ddc could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:41:50.618201 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-892fc8f2-c068-430b-8701-87305121324d tempest-AttachVolumeShelveTestJSON-1379355146 tempest-AttachVolumeShelveTestJSON-1379355146-project] 10.222.0.52 "GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc" status: 404 len: 111 microversion: 2.20 time: 0.035503 Jul 14 20:41:50.618201 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 431/853] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 14 20:41:50 2022] GET /compute/v2.1/servers/e306d8c2-449e-43db-8e98-53d049726ddc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 20:41:56.905900 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c94f9d94-fde2-400b-94b6-6fda7003812c tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Action: 'create', calling method: .version_select at 0x7fafb17e6ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1076981621"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:57.220488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c94f9d94-fde2-400b-94b6-6fda7003812c tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.609785 Jul 14 20:41:57.221308 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 423/854] 10.222.0.52 () {60 vars in 1154 bytes} [Thu Jul 14 20:41:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 611 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 20:41:57.233096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c19ff3ea-9d8d-4683-aa87-276063a03a11 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb18a4670>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:57.288448 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c19ff3ea-9d8d-4683-aa87-276063a03a11 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d" status: 200 len: 345 microversion: 2.1 time: 0.059847 Jul 14 20:41:57.289060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 432/855] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:57 2022] GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:58.302132 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4515927a-a360-44c3-be1a-eaef94b9b16d tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb19bf0d0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:58.350360 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4515927a-a360-44c3-be1a-eaef94b9b16d tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d" status: 200 len: 346 microversion: 2.1 time: 0.052598 Jul 14 20:41:58.350962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 424/856] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:41:58 2022] GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:58.362384 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-72576cc5-0ae0-4c73-8ac5-bf2e4d828d50 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Action: 'create', calling method: .version_select at 0x7fafb189e4c0>, body: {"snapshot": {"volume_id": "b2c68ffe-3205-4a5f-ae11-3e3450f9c27d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1757193168"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:41:58.513972 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-72576cc5-0ae0-4c73-8ac5-bf2e4d828d50 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.155800 Jul 14 20:41:58.514560 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 433/857] 10.222.0.52 () {60 vars in 1161 bytes} [Thu Jul 14 20:41:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:58.524803 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ba1d5236-9b8d-490f-8f25-1182cb9b18ee tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb1a69d30>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:58.555838 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ba1d5236-9b8d-490f-8f25-1182cb9b18ee tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 200 len: 287 microversion: 2.1 time: 0.034871 Jul 14 20:41:58.556446 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 425/858] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:41:58 2022] GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:58.567412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f5d249a0-5f66-4b9a-937b-3c3eebcde8f5 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb18cbe50>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:58.597786 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f5d249a0-5f66-4b9a-937b-3c3eebcde8f5 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034045 Jul 14 20:41:58.598349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 434/859] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Jul 14 20:41:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:58.608827 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-5a032eca-c274-4d16-b480-58c5528d100a tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb183b5e0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:58.639915 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-5a032eca-c274-4d16-b480-58c5528d100a tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 200 len: 287 microversion: 2.1 time: 0.035409 Jul 14 20:41:58.640487 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 426/860] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:41:58 2022] GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:41:59.652191 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cd2385ee-7278-43e6-a22a-86aa7d1d4a98 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb1991ee0>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:41:59.686368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cd2385ee-7278-43e6-a22a-86aa7d1d4a98 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 200 len: 287 microversion: 2.1 time: 0.038465 Jul 14 20:41:59.686926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 435/861] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:41:59 2022] GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:00.695137 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=9 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:00.695803 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:00.699849 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e6b96014-66a7-486e-9e0d-059b7495b7c1 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb1a4f3a0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:00.731185 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e6b96014-66a7-486e-9e0d-059b7495b7c1 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 200 len: 287 microversion: 2.1 time: 0.037227 Jul 14 20:42:00.731752 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 427/862] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:42:00 2022] GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:01.742401 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:01.742804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=17 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:01.746843 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cba13256-df04-40e3-bdb5-efb4e002054f tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb18038b0>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:01.778190 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cba13256-df04-40e3-bdb5-efb4e002054f tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 200 len: 288 microversion: 2.1 time: 0.037205 Jul 14 20:42:01.778753 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 436/863] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:42:01 2022] GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:01.789356 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-aaaa66a2-a90e-497b-afd0-3ee5df40da47 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb19bf940>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:01.846003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-aaaa66a2-a90e-497b-afd0-3ee5df40da47 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 202 len: 0 microversion: 2.1 time: 0.060870 Jul 14 20:42:01.846574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 428/864] 10.222.0.52 () {58 vars in 1253 bytes} [Thu Jul 14 20:42:01 2022] DELETE /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:42:01.855430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1abab267-3d69-4adc-8c54-f3addb2a58bb tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb1803d30>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:01.883922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1abab267-3d69-4adc-8c54-f3addb2a58bb tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 200 len: 287 microversion: 2.1 time: 0.032880 Jul 14 20:42:01.884469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 437/865] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:42:01 2022] GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:02.897504 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3a84c022-c30a-4ab4-86b1-e09a1450de59 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb19789d0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:02.922549 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-3a84c022-c30a-4ab4-86b1-e09a1450de59 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] HTTP exception thrown: Snapshot 5742d67b-15e8-42f4-903d-15b3bffb591c could not be found. Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3a84c022-c30a-4ab4-86b1-e09a1450de59 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Request method failure captured: Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c HTTP/1.1 Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H-ULOHeZCoQQnBjVkjlkR8_jufTtEGMUcX3PhZKqwGotgGZhlPlgWQm-m2J3ncQ4N0cxYKTfryMLn55piSW7RVlm8SB2As60O_9QWF11N8EDyu5sHhdg-zmEWh_5JxMaRhDe5FEFKgjVI_beLXNZXRvH10Hjy6h7JeAChSP0v2QRPo Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:42:02.925040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d560d6eb35a84b818714812740ef84cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 5d9d154fe4cf483cabd187c8012a9b13 Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Snapshot 5742d67b-15e8-42f4-903d-15b3bffb591c could not be found. Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '5742d67b-15e8-42f4-903d-15b3bffb591c'} Jul 14 20:42:02.926704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5742d67b-15e8-42f4-903d-15b3bffb591c could not be found. (HTTP 404) (Request-ID: req-97dace13-7179-420e-9af1-7aad08b8df43) Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:02.927721 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:42:02.928880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5742d67b-15e8-42f4-903d-15b3bffb591c could not be found. Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 20:42:02.930077 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5742d67b-15e8-42f4-903d-15b3bffb591c could not be found. Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5742d67b-15e8-42f4-903d-15b3bffb591c could not be found. Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3a84c022-c30a-4ab4-86b1-e09a1450de59 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Returning 404 to user: Snapshot 5742d67b-15e8-42f4-903d-15b3bffb591c could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:42:02.932439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3a84c022-c30a-4ab4-86b1-e09a1450de59 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c" status: 404 len: 111 microversion: 2.1 time: 0.033944 Jul 14 20:42:02.933780 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 429/866] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:42:02 2022] GET /compute/v2.1/os-snapshots/5742d67b-15e8-42f4-903d-15b3bffb591c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:42:02.940076 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8a7c92a3-9825-42b7-b865-296fde7d6edb tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb189eb80>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:03.006348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8a7c92a3-9825-42b7-b865-296fde7d6edb tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d" status: 202 len: 0 microversion: 2.1 time: 0.070515 Jul 14 20:42:03.006974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 438/867] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:42:02 2022] DELETE /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:42:03.015813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2ef26eed-99bb-4d33-92fa-9e9500bb3b71 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb19bfca0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:03.074850 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2ef26eed-99bb-4d33-92fa-9e9500bb3b71 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d" status: 200 len: 345 microversion: 2.1 time: 0.063434 Jul 14 20:42:03.075514 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 430/868] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:42:03 2022] GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:04.088699 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-341a46cc-3e37-4fed-849d-7ca510b56e3a tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb17a50d0>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:04.125005 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-341a46cc-3e37-4fed-849d-7ca510b56e3a tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] HTTP exception thrown: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-341a46cc-3e37-4fed-849d-7ca510b56e3a tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Request method failure captured: Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d HTTP/1.1 Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H-ULOHeZCoQQnBjVkjlkR8_jufTtEGMUcX3PhZKqwGotgGZhlPlgWQm-m2J3ncQ4N0cxYKTfryMLn55piSW7RVlm8SB2As60O_9QWF11N8EDyu5sHhdg-zmEWh_5JxMaRhDe5FEFKgjVI_beLXNZXRvH10Hjy6h7JeAChSP0v2QRPo Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:42:04.127305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d560d6eb35a84b818714812740ef84cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 5d9d154fe4cf483cabd187c8012a9b13 Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'b2c68ffe-3205-4a5f-ae11-3e3450f9c27d'} Jul 14 20:42:04.128974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. (HTTP 404) (Request-ID: req-01e90457-1734-4790-a054-b5672a57ef6f) Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.139449 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:42:04.140929 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 20:42:04.142426 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-341a46cc-3e37-4fed-849d-7ca510b56e3a tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Returning 404 to user: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-341a46cc-3e37-4fed-849d-7ca510b56e3a tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d" status: 404 len: 109 microversion: 2.1 time: 0.044984 Jul 14 20:42:04.144532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 439/869] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:42:04 2022] GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:42:04.155632 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-70ff3a11-7777-4321-b9f0-6164cf64724c tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb19783a0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:04.192926 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-70ff3a11-7777-4321-b9f0-6164cf64724c tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] HTTP exception thrown: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-70ff3a11-7777-4321-b9f0-6164cf64724c tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Request method failure captured: Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d HTTP/1.1 Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H-ULOHeZCoQQnBjVkjlkR8_jufTtEGMUcX3PhZKqwGotgGZhlPlgWQm-m2J3ncQ4N0cxYKTfryMLn55piSW7RVlm8SB2As60O_9QWF11N8EDyu5sHhdg-zmEWh_5JxMaRhDe5FEFKgjVI_beLXNZXRvH10Hjy6h7JeAChSP0v2QRPo Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:42:04.194962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d560d6eb35a84b818714812740ef84cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 5d9d154fe4cf483cabd187c8012a9b13 Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'b2c68ffe-3205-4a5f-ae11-3e3450f9c27d'} Jul 14 20:42:04.196450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. (HTTP 404) (Request-ID: req-98f3d2a1-3280-4112-b16e-cfcbbc7e75b2) Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.201557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 20:42:04.203172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 20:42:04.205030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-70ff3a11-7777-4321-b9f0-6164cf64724c tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Returning 404 to user: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-70ff3a11-7777-4321-b9f0-6164cf64724c tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d" status: 404 len: 109 microversion: 2.1 time: 0.048106 Jul 14 20:42:04.207008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 431/870] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:42:04 2022] DELETE /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:42:04.208584 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3d99d6a1-d819-4819-ae63-984cff58fcf9 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Calling method '.version_select at 0x7fafb18cbf70>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:04.239151 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-3d99d6a1-d819-4819-ae63-984cff58fcf9 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] HTTP exception thrown: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3d99d6a1-d819-4819-ae63-984cff58fcf9 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Request method failure captured: Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d HTTP/1.1 Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H-ULOHeZCoQQnBjVkjlkR8_jufTtEGMUcX3PhZKqwGotgGZhlPlgWQm-m2J3ncQ4N0cxYKTfryMLn55piSW7RVlm8SB2As60O_9QWF11N8EDyu5sHhdg-zmEWh_5JxMaRhDe5FEFKgjVI_beLXNZXRvH10Hjy6h7JeAChSP0v2QRPo Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:42:04.241192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d560d6eb35a84b818714812740ef84cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d560d6eb35a84b818714812740ef84cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: d560d6eb35a84b818714812740ef84cf Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1243643569 Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 5d9d154fe4cf483cabd187c8012a9b13 Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1243643569-project Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'b2c68ffe-3205-4a5f-ae11-3e3450f9c27d'} Jul 14 20:42:04.243662 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. (HTTP 404) (Request-ID: req-4db11e69-3aad-496d-a386-1f5b1c5e4db8) Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.245987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 20:42:04.247804 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 20:42:04.253182 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3d99d6a1-d819-4819-ae63-984cff58fcf9 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] Returning 404 to user: Volume b2c68ffe-3205-4a5f-ae11-3e3450f9c27d could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3d99d6a1-d819-4819-ae63-984cff58fcf9 tempest-VolumesSnapshotsTestJSON-1243643569 tempest-VolumesSnapshotsTestJSON-1243643569-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d" status: 404 len: 109 microversion: 2.1 time: 0.039087 Jul 14 20:42:04.254833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 440/871] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 14 20:42:04 2022] GET /compute/v2.1/os-volumes/b2c68ffe-3205-4a5f-ae11-3e3450f9c27d => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:42:12.243032 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1706774516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1335986240", "security_groups": [{"name": "tempest-secgroup-smoke-2107497457"}], "block_device_mapping_v2": [{"uuid": "30f5ba81-8097-4110-b99e-17c3751ac551", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c361a5af-edf6-43ec-86b8-8164b7612499"}]}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:12.636862 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] validate_networks() for [('c361a5af-edf6-43ec-86b8-8164b7612499', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:42:13.493547 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:42:13.494362 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:42:13.495141 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:42:13.495670 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:42:13.496296 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:42:13.512576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:13.513189 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:13.515735 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:13.516298 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:13.562893 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:42:13.584966 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Getting quotas for user 6502e3ffa3b84333a00ea5f712767d61 and project 83a29cbfb7484b76a9131a3b81832c62. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:42:13.724405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:42:13.726705 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30f5ba81-8097-4110-b99e-17c3751ac551',volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:42:13.987884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-aeb55d54-c2e1-4fb5-8b83-d53eeeee3ad6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.750180 Jul 14 20:42:13.992217 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 432/872] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:42:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:42:14.002888 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1c51f7ae-c923-48fb-9901-cc819cacda5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:14.005497 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1c51f7ae-c923-48fb-9901-cc819cacda5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:14.143187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1c51f7ae-c923-48fb-9901-cc819cacda5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:14.158270 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1c51f7ae-c923-48fb-9901-cc819cacda5b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1095 microversion: 2.1 time: 0.159617 Jul 14 20:42:14.169177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 441/873] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:13 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1095 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:15.177062 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:15.178296 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:15.192942 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:15.193298 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:15.194179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:15.194919 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:15.351870 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:15.376203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0f234f1d-c6d9-4f17-8347-067823d96b16 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1193 microversion: 2.1 time: 0.203849 Jul 14 20:42:15.377081 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 433/874] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:15 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1193 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:16.399468 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:16.400343 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:16.418068 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:16.419925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:16.423679 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:16.424263 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:16.529750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:16.559039 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-46acf991-dc0b-4a1e-8e0b-3b4be31667d8 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1211 microversion: 2.1 time: 0.167601 Jul 14 20:42:16.562959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 442/875] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:16 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:17.132575 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7c9b5ddc-f63b-42c9-9841-06b82282a734 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Action: 'create', calling method: .version_select at 0x7fafb1aa6550>, body: {"keypair": {"name": "tempest-TestShelveInstance-178469649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSbQ0LWcY13Uiy4AdJe3FIWcJpuIBEgVjV1rGbcWJ4hOjXc5JGir8FsabuJx8g1N3lm2ZNfexqNmWgQ5al1mPyXf5ogrcxkV621kedLI5ndi6x1MQjArzuuaISAAFLNbg=="}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:17.148131 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-7c9b5ddc-f63b-42c9-9841-06b82282a734 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Getting quotas for project c8ded6a71283444e892094501f29e4da. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:42:17.152671 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-7c9b5ddc-f63b-42c9-9841-06b82282a734 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Getting quotas for user c0d43152eeb9485e9ff16f38aa63ac22 and project c8ded6a71283444e892094501f29e4da. Resources: {'key_pairs'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:42:17.175890 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7c9b5ddc-f63b-42c9-9841-06b82282a734 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.443695 Jul 14 20:42:17.176481 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 434/876] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:42:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:42:17.583264 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:17.583878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:17.590218 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:17.590669 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:17.591467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:17.592111 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:17.840823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-c09ee0df-ecae-4be0-a126-9ea5ff432095 req-51d262af-5f3a-4d7d-b33e-b1b02b98b732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8", "tag": "888019b8-69f1-44bf-b3ed-5afda837d4b0"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:17.854248 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-c09ee0df-ecae-4be0-a126-9ea5ff432095 req-51d262af-5f3a-4d7d-b33e-b1b02b98b732 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:17.854883 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-c09ee0df-ecae-4be0-a126-9ea5ff432095 req-51d262af-5f3a-4d7d-b33e-b1b02b98b732 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:17.875083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-c09ee0df-ecae-4be0-a126-9ea5ff432095 req-51d262af-5f3a-4d7d-b33e-b1b02b98b732 service nova] Creating event network-changed:888019b8-69f1-44bf-b3ed-5afda837d4b0 for instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 on hv-cinder-79987 Jul 14 20:42:17.886318 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-c09ee0df-ecae-4be0-a126-9ea5ff432095 req-51d262af-5f3a-4d7d-b33e-b1b02b98b732 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053334 Jul 14 20:42:17.887311 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 435/877] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:42:17.954984 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:17.971215 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f851016d-e08f-45db-b96c-576fcd549caf tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.391509 Jul 14 20:42:17.974366 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 443/878] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:17 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:19.004334 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:19.007975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:19.044637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:19.045452 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:19.046267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:19.046710 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:19.326309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:19.361657 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3a1be22b-8991-4da6-b362-59ac37c37d38 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.373597 Jul 14 20:42:19.362256 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 436/879] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:18 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:20.379046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:20.380691 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:20.389606 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:20.390161 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:20.391187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:20.392474 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:20.582733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:20.597481 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8aadf5a1-180a-4f0e-ac97-7fa8c7846f5f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.223361 Jul 14 20:42:20.609807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 444/880] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:20 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:21.624886 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:21.625493 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:21.632309 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:21.632724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:21.633650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:21.633959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:21.789829 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:21.802342 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a5ce0162-6b42-497f-89f8-66aa75d84dcd tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.181159 Jul 14 20:42:21.802965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 437/881] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:21 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:22.821291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:22.822349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:22.828437 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:22.828889 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:22.829646 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:22.830079 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:22.966147 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:22.974654 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9809b471-7ba9-4139-a1c9-17c57cb2ff0f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.158331 Jul 14 20:42:22.975624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 445/882] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:22 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:23.992203 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:23.992809 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:23.995506 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:24.002887 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:24.003634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:24.004810 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:24.005399 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:24.156843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:24.172648 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-aeea62e7-6775-409f-87c4-8f96ad8445a6 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.184228 Jul 14 20:42:24.173279 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 438/883] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:23 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:25.190596 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:25.196003 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:25.196748 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:25.203866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:25.204399 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:25.205172 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:25.205606 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:25.366635 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:25.375985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9215bae8-a77f-4e51-8498-847cd9a1af25 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.187459 Jul 14 20:42:25.376577 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 446/884] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:25 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:26.037611 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:26.038184 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:26.044920 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:26.049483 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:26.050623 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:26.051172 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:26.155073 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lazy-loading 'services' on Instance uuid e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:42:26.240613 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-35c09889-b433-44df-8144-f559eba76291 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-volume_attachments/7d9c769d-0e1a-40d2-952c-3a49e39c3826" status: 202 len: 0 microversion: 2.1 time: 0.206620 Jul 14 20:42:26.241301 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 439/885] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:42:26 2022] DELETE /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-volume_attachments/7d9c769d-0e1a-40d2-952c-3a49e39c3826 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 20:42:26.402692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:26.403526 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:26.410350 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:26.410833 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:26.411640 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:26.412393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:26.593997 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:26.602177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3b9a9a1c-cd93-4d26-bc8c-8c80ca045346 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.203336 Jul 14 20:42:26.603399 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 447/886] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:26 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:27.621771 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:27.622627 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:27.626074 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=10 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:27.632665 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:27.633109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:27.633894 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:27.634405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:27.776204 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:27.783716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-050afcbc-db15-4220-8100-ddcd12ad99ac tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.167321 Jul 14 20:42:27.784277 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 440/887] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:27 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:28.164688 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1914848263", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "networks": [{"uuid": "33641e48-7817-4fd4-b018-04fb34fd9d08"}]}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:28.220528 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.network.neutron [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] validate_networks() for [('33641e48-7817-4fd4-b018-04fb34fd9d08', None, None, None, None, None)] {{(pid=124370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:42:28.416652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d2ade41d-2d78-4b7b-87f1-2b66dbe8f2b5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:28.422759 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d2ade41d-2d78-4b7b-87f1-2b66dbe8f2b5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.423263 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d2ade41d-2d78-4b7b-87f1-2b66dbe8f2b5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.447785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d2ade41d-2d78-4b7b-87f1-2b66dbe8f2b5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Going to try to stop instance {{(pid=124371) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 20:42:28.495001 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d2ade41d-2d78-4b7b-87f1-2b66dbe8f2b5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action" status: 202 len: 0 microversion: 2.1 time: 0.082090 Jul 14 20:42:28.495616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 441/888] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:42:28 2022] POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 20:42:28.505425 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:28.506127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:28.513135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.513645 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.514548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.515022 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.732918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Flavor limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:42:28.733421 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Image limits 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:42:28.734048 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Flavor pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:42:28.734657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Image pref 0:0:0 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:42:28.735406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.virt.hardware [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:42:28.738723 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:28.746672 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.747206 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9f8f206d-c7d2-4387-b8c4-ed38fb034969 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.246816 Jul 14 20:42:28.747393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.748356 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.748503 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 442/889] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:28 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:28.749098 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.771311 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Getting quotas for project d2fb85822f104b7a981279226f8f1aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:42:28.775633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Getting quotas for user aa4214b07ad54de69e689254dfc99eb3 and project d2fb85822f104b7a981279226f8f1aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:42:28.786768 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Going to run 1 instances... {{(pid=124370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:42:28.789040 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:42:28.801413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:28.802025 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:28.809160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.809725 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.815701 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.816154 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.843112 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-58390fc2-de1d-4f2b-9010-759e3c2594db tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681499 Jul 14 20:42:28.845266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 448/890] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:42:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:42:28.852069 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-b05c975f-a3c8-463f-b7e1-944fb85f764d req-7cc92d3f-3913-4e56-a9cf-53b20205747d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8", "name": "network-vif-plugged", "status": "completed", "tag": "888019b8-69f1-44bf-b3ed-5afda837d4b0"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:28.865670 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-b05c975f-a3c8-463f-b7e1-944fb85f764d req-7cc92d3f-3913-4e56-a9cf-53b20205747d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:28.866691 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-b05c975f-a3c8-463f-b7e1-944fb85f764d req-7cc92d3f-3913-4e56-a9cf-53b20205747d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:28.888117 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-b05c975f-a3c8-463f-b7e1-944fb85f764d req-7cc92d3f-3913-4e56-a9cf-53b20205747d service nova] Creating event network-vif-plugged:888019b8-69f1-44bf-b3ed-5afda837d4b0 for instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 on hv-cinder-79987 Jul 14 20:42:28.894894 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-b05c975f-a3c8-463f-b7e1-944fb85f764d req-7cc92d3f-3913-4e56-a9cf-53b20205747d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046832 Jul 14 20:42:28.896291 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 449/891] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:28.902479 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4d286a45-5f88-4018-b9c7-cb318174ce47 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:28.903329 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4d286a45-5f88-4018-b9c7-cb318174ce47 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:28.989942 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4d286a45-5f88-4018-b9c7-cb318174ce47 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:28.997959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4d286a45-5f88-4018-b9c7-cb318174ce47 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1219 microversion: 2.1 time: 0.100197 Jul 14 20:42:28.998618 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 450/892] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:28 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:29.016326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:29.026895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9eb5ef9e-df6a-49be-a6a4-6391d8670791 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.229549 Jul 14 20:42:29.036768 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 443/893] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:28 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:29.765624 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:29.766549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:29.773887 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:29.774334 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:29.775184 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:29.775620 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:29.909483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:29.917023 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1e158af0-8205-4d07-a2a9-874537b535da tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.155299 Jul 14 20:42:29.917614 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 451/894] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:29 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:30.015608 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:30.016343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:30.022930 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:30.023419 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:30.024192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:30.024663 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:30.046552 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:30.047341 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:30.055297 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:30.056379 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:30.057331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:30.057815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:30.096519 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:30.105629 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ddf9ebd8-ede7-4082-a6ba-329b2148d37f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1215 microversion: 2.1 time: 0.093642 Jul 14 20:42:30.106208 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 444/895] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:30 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:30.205895 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:30.213351 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-fc70ee97-223e-4844-8678-b942e37530a4 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1267 microversion: 2.1 time: 0.172502 Jul 14 20:42:30.213996 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 452/896] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:30 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:30.935228 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:30.935779 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:30.943374 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:30.943823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:30.944587 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:30.945021 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:31.099628 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:31.108396 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d57fe6d7-e165-4718-8a15-7b37fc0bef44 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.177166 Jul 14 20:42:31.108967 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 445/897] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:30 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:31.123934 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:31.124657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:31.133357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:31.134562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:31.135292 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:31.137441 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:31.221060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:31.230544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:31.231427 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:31.235969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-26592c9c-f119-4610-8cd9-1c32675b31f8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1289 microversion: 2.1 time: 0.116924 Jul 14 20:42:31.236572 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 453/898] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:31 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:31.239268 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:31.239719 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:31.240506 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:31.240943 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:31.451851 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:31.460505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b4b3d3f7-9d35-47b1-92af-e5f3ba39a9ef tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1454 microversion: 2.1 time: 0.234243 Jul 14 20:42:31.461085 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 446/899] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:31 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1454 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:31.479164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:31.479647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:31.485800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:31.486248 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:31.487073 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:31.487511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:31.689777 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:31.698815 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-471cbad9-2b49-4948-82f4-7edefa242def tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1454 microversion: 2.1 time: 0.225012 Jul 14 20:42:31.699512 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 454/900] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:31 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1454 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:32.126559 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:32.127847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:32.134464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:32.135238 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:32.136236 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:32.136898 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:32.253957 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:32.254532 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:32.261891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:32.262523 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:32.263412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:32.264116 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:32.428401 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:32.439586 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-affaaee1-b263-467b-b003-6332204561e0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.316430 Jul 14 20:42:32.440513 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 447/901] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:32 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:32.530304 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:32.538921 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-40bc27e9-d2dc-479e-9cf9-743e22b36897 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1319 microversion: 2.1 time: 0.288923 Jul 14 20:42:32.539533 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 455/902] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:32 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:32.868131 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-eb39fd2c-c97d-477d-9999-917732a721c0 req-9d2b685e-a2eb-4b51-af97-c45786fca4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e953341a-d18f-4927-9e2f-2e3990f8959b", "tag": "8da29d94-af65-43ce-a17a-e89f96b50b93"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:32.885116 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-eb39fd2c-c97d-477d-9999-917732a721c0 req-9d2b685e-a2eb-4b51-af97-c45786fca4cb service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:32.886127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-eb39fd2c-c97d-477d-9999-917732a721c0 req-9d2b685e-a2eb-4b51-af97-c45786fca4cb service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:32.898753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-eb39fd2c-c97d-477d-9999-917732a721c0 req-9d2b685e-a2eb-4b51-af97-c45786fca4cb service nova] Creating event network-changed:8da29d94-af65-43ce-a17a-e89f96b50b93 for instance e953341a-d18f-4927-9e2f-2e3990f8959b on hv-cinder-79987 Jul 14 20:42:32.906795 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-eb39fd2c-c97d-477d-9999-917732a721c0 req-9d2b685e-a2eb-4b51-af97-c45786fca4cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047484 Jul 14 20:42:32.907992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 448/903] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:42:33.457103 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:33.457812 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:33.465029 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:33.465547 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:33.466387 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:33.466827 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:33.559049 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:33.560924 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:33.568145 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:33.569151 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:33.570158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:33.571576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:33.606000 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:33.614123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-260b197b-4a45-423a-acc7-12926265380e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.160759 Jul 14 20:42:33.623874 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 456/904] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:33 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:33.625562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-8942ea00-2aed-4948-9775-5a2260df745a req-1c93e178-92f6-4119-92b0-fe968ffa4bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8", "tag": "888019b8-69f1-44bf-b3ed-5afda837d4b0"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:33.642682 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-8942ea00-2aed-4948-9775-5a2260df745a req-1c93e178-92f6-4119-92b0-fe968ffa4bd7 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:33.643164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-8942ea00-2aed-4948-9775-5a2260df745a req-1c93e178-92f6-4119-92b0-fe968ffa4bd7 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:33.655282 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-8942ea00-2aed-4948-9775-5a2260df745a req-1c93e178-92f6-4119-92b0-fe968ffa4bd7 service nova] Creating event network-changed:888019b8-69f1-44bf-b3ed-5afda837d4b0 for instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 on hv-cinder-79987 Jul 14 20:42:33.660345 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-8942ea00-2aed-4948-9775-5a2260df745a req-1c93e178-92f6-4119-92b0-fe968ffa4bd7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038338 Jul 14 20:42:33.661046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 457/905] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:42:33.726666 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:33.731080 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:33.735878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f721319c-8bd4-4958-afd0-a2ac94546c0e tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1319 microversion: 2.1 time: 0.182983 Jul 14 20:42:33.736451 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 449/906] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:33 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:34.633194 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:34.634681 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:34.644810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:34.645503 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:34.646700 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:34.646700 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:34.754167 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:34.755666 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:34.766189 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:34.766928 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:34.767751 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:34.768215 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:35.119985 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:35.127483 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8c68b248-9d4e-4dc8-98f0-c0d769e7168f tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1319 microversion: 2.1 time: 0.378164 Jul 14 20:42:35.128060 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 450/907] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:34 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:35.168954 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:35.176739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-57028d4b-3577-4518-96df-069a6b877644 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.548637 Jul 14 20:42:35.177508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 458/908] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:34 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:36.144404 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:36.144945 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:36.151435 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:36.151881 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:36.152641 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:36.153076 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:36.193633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:36.194241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:36.202241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:36.202691 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:36.203495 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:36.203937 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:36.342352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:36.349856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ad1f3928-1a02-4de2-aaae-dd66a5781e20 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1319 microversion: 2.1 time: 0.209659 Jul 14 20:42:36.350556 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 451/909] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:36 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:36.372127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:36.380145 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-92e2c2fa-e666-49a3-9788-56bd5d4aa85e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.190412 Jul 14 20:42:36.380696 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 459/910] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:36 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:36.697649 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-76177943", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-178469649", "security_groups": [{"name": "tempest-secgroup-smoke-159862638"}], "networks": [{"uuid": "e7b9cd92-b78c-490d-aec4-6eeb43205f28"}], "block_device_mapping_v2": [{"uuid": "44ea3c31-3359-4bba-83ff-27a1acacb0bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:36.812200 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] validate_networks() for [('e7b9cd92-b78c-490d-aec4-6eeb43205f28', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:42:37.183334 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:42:37.183949 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:42:37.184210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:42:37.184615 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:42:37.185024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:42:37.194976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:37.195424 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:37.196802 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:37.197239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:37.214207 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Getting quotas for project c8ded6a71283444e892094501f29e4da. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:42:37.218099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Getting quotas for user c0d43152eeb9485e9ff16f38aa63ac22 and project c8ded6a71283444e892094501f29e4da. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:42:37.278108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:42:37.280266 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44ea3c31-3359-4bba-83ff-27a1acacb0bd',volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:42:37.367657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:37.368853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:37.388522 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:37.388956 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:37.389746 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:37.390193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:37.422068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-20e0a7b2-6f21-4578-8717-5c722dce627c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.728241 Jul 14 20:42:37.427719 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 452/911] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:42:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:42:37.429856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:37.431173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:37.437979 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:37.438569 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:37.439489 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:37.439996 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:37.596680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:37.605878 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6a374585-ab9c-4384-a844-0faaf50a1399 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1319 microversion: 2.1 time: 0.241887 Jul 14 20:42:37.607218 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 460/912] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:37 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:37.612063 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-2661c8fb-c7d2-479e-8957-025596478d73 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:37.612879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-2661c8fb-c7d2-479e-8957-025596478d73 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:37.625812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:37.644439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3b436869-8bbf-4b61-80c5-cded00cf180b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.219727 Jul 14 20:42:37.645142 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 453/913] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:37 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:37.673379 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-2661c8fb-c7d2-479e-8957-025596478d73 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:37.681268 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-2661c8fb-c7d2-479e-8957-025596478d73 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1086 microversion: 2.1 time: 0.072852 Jul 14 20:42:37.681840 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 461/914] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:37 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1086 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:38.623078 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:38.623691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:38.640872 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:38.641308 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:38.642298 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:38.642741 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:38.664275 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:38.668355 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:38.675640 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:38.676452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:38.677192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:38.677630 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:38.698975 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=100 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:38.758553 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=2 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:38.957028 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:38.965133 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1d39f1f4-cb9b-4cd2-ab77-ca9e8bb8212b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1319 microversion: 2.1 time: 0.345945 Jul 14 20:42:38.965708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 454/915] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:38 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:38.965983 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:38.971003 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:38.971789 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:38.973867 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-7d564c1d-9467-4101-97ea-843490caf279 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1675 microversion: 2.1 time: 0.316148 Jul 14 20:42:38.974436 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 462/916] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:38 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1675 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:38.985425 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:38.986183 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:38.987776 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-a668837e-9250-4578-b016-f91d7d474f60 req-300aa606-f6dc-4b86-8fdd-692065f81cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e953341a-d18f-4927-9e2f-2e3990f8959b", "name": "network-vif-plugged", "status": "completed", "tag": "8da29d94-af65-43ce-a17a-e89f96b50b93"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:38.987958 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:38.988529 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:38.999985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a668837e-9250-4578-b016-f91d7d474f60 req-300aa606-f6dc-4b86-8fdd-692065f81cd2 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:39.000796 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a668837e-9250-4578-b016-f91d7d474f60 req-300aa606-f6dc-4b86-8fdd-692065f81cd2 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:39.021175 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-a668837e-9250-4578-b016-f91d7d474f60 req-300aa606-f6dc-4b86-8fdd-692065f81cd2 service nova] Creating event network-vif-plugged:8da29d94-af65-43ce-a17a-e89f96b50b93 for instance e953341a-d18f-4927-9e2f-2e3990f8959b on hv-cinder-79987 Jul 14 20:42:39.028075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-a668837e-9250-4578-b016-f91d7d474f60 req-300aa606-f6dc-4b86-8fdd-692065f81cd2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052271 Jul 14 20:42:39.028831 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 463/917] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:39.073614 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:39.083505 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2543672d-ec53-4350-b2a0-51ee197197ea tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1202 microversion: 2.1 time: 0.116338 Jul 14 20:42:39.095397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 455/918] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:38 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1202 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:39.983653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:39.984269 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:39.991052 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:39.991325 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:39.991758 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:39.992089 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:39.992244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:39.992522 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.001263 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.001839 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.002752 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.003352 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.303144 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:40.311161 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:40.311338 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5ec2cd18-cd64-4cc1-aa7b-c236ac042cf5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1319 microversion: 2.1 time: 0.332197 Jul 14 20:42:40.311841 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 464/919] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:39 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:40.316723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:40.317520 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:40.323127 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8b26e633-8339-4c67-8b69-aa3832bdae01 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1652 microversion: 2.1 time: 0.335649 Jul 14 20:42:40.323840 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 456/920] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:39 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1652 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:40.325224 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.325676 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.326529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.327162 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.340640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c81c10c3-b284-4d42-a83d-872d8b74f783 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:40.347469 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c81c10c3-b284-4d42-a83d-872d8b74f783 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.348009 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c81c10c3-b284-4d42-a83d-872d8b74f783 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.373140 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c81c10c3-b284-4d42-a83d-872d8b74f783 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Going to try to start instance {{(pid=124371) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 20:42:40.416197 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c81c10c3-b284-4d42-a83d-872d8b74f783 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action" status: 202 len: 0 microversion: 2.1 time: 0.079749 Jul 14 20:42:40.416810 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 457/921] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:42:40 2022] POST /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 20:42:40.425488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:40.426194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:40.433182 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.433652 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.434445 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.434880 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.593447 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:40.601536 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d8692100-f72c-4c72-bdec-99b0239c058b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.288531 Jul 14 20:42:40.602101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 465/922] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:40 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:40.609266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-ffd0736d-7968-4b3d-adcb-71b396291892 req-63dc6352-3b7d-4047-a7ac-59b5edb95b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a61a7eb-3c48-4e25-91b7-93ba228b1082", "tag": "da21b590-1f64-4742-b37a-d9aa9698c268"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:40.621559 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-ffd0736d-7968-4b3d-adcb-71b396291892 req-63dc6352-3b7d-4047-a7ac-59b5edb95b34 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:40.622077 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-ffd0736d-7968-4b3d-adcb-71b396291892 req-63dc6352-3b7d-4047-a7ac-59b5edb95b34 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:40.649540 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-ffd0736d-7968-4b3d-adcb-71b396291892 req-63dc6352-3b7d-4047-a7ac-59b5edb95b34 service nova] Creating event network-changed:da21b590-1f64-4742-b37a-d9aa9698c268 for instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 on hv-cinder-79987 Jul 14 20:42:40.654412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-ffd0736d-7968-4b3d-adcb-71b396291892 req-63dc6352-3b7d-4047-a7ac-59b5edb95b34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048696 Jul 14 20:42:40.655631 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 466/923] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:40.676273 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:40.686181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a0cf95b1-b5bd-4200-828b-f496b5fa4296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1661 microversion: 2.1 time: 0.264654 Jul 14 20:42:40.686785 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 458/924] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:40 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1661 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:41.329328 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:41.329926 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:41.336117 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:41.336577 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:41.337417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:41.337858 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:41.574959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:41.583896 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-288eab39-98c4-4463-8f35-18f2e8f14032 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1508 microversion: 2.1 time: 0.259034 Jul 14 20:42:41.584417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 467/925] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:41 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:41.624739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:41.625337 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:41.643076 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:41.643535 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:41.644597 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:41.645038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:41.705007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:41.705763 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:41.714092 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:41.714971 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:41.716002 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:41.716694 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:42.221280 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:42.228949 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-0d2c5405-9659-4f9c-8501-59027171f1f1 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.608152 Jul 14 20:42:42.229516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 459/926] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:41 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:42.230300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:42.239628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c9ce4a96-183f-4d15-9d02-e30b8d308a12 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1661 microversion: 2.1 time: 0.539106 Jul 14 20:42:42.240188 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 468/927] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:41 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1661 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:43.246112 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:43.246709 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:43.249170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:43.254548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:43.255016 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:43.255789 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:43.256223 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:43.256535 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:43.257836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:43.266969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:43.267416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:43.268289 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:43.269008 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:43.469545 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:43.473010 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:43.478667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3e577f96-b328-4d05-8751-5e0aee6e63fb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.236667 Jul 14 20:42:43.479258 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 460/928] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:43 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:43.481292 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e8723b88-f9b4-46e7-8ca4-58f5ad64a7cc tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1661 microversion: 2.1 time: 0.228513 Jul 14 20:42:43.481930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 469/929] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:43 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1661 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:44.496202 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:44.496817 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:44.497838 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:44.498454 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:44.500927 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:44.504755 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:44.505388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:44.506055 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:44.506318 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:44.506512 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:44.506973 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:44.507310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:44.507749 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:44.708825 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:44.713424 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:44.716920 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a8bc1663-62ec-4236-9d63-882722638247 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.225071 Jul 14 20:42:44.721082 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 461/930] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:44 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:44.723811 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-44c2be1b-0d6c-4d9f-b5b0-7849cca0dafb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1665 microversion: 2.1 time: 0.229588 Jul 14 20:42:44.724391 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 470/931] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:44 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1665 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:45.742068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:45.742611 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:45.749954 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:45.750401 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:45.751191 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:45.751625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:45.886621 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:45.894599 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9c0d0ba2-30ff-49ce-9302-ec81562a1982 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.163647 Jul 14 20:42:45.895206 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 462/932] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:45 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:46.911633 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:46.912218 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:46.918807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:46.919289 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:46.920063 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:46.920496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:47.053711 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:47.061903 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c32046e1-851d-4620-b695-e9fa6a64c246 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.154235 Jul 14 20:42:47.062478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 471/933] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:46 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:48.079432 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:48.079989 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:48.082282 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:48.083081 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=6 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:48.088706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:48.089156 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:48.089930 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:48.090373 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:48.229152 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:48.236673 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f5fb714a-3406-4d5b-beb6-ef6e3065007d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.161192 Jul 14 20:42:48.237235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 463/934] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:48 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:49.254623 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:49.255275 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:49.257224 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=10 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:49.264177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:49.264634 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:49.265524 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:49.265961 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:49.402609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:49.410666 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dcc7df78-d1b6-4196-8771-a6223e8a312b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.159931 Jul 14 20:42:49.411251 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 472/935] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:49 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:42:50.428192 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:50.428796 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:50.436020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:50.436469 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:50.437248 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:50.437722 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:50.573791 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:50.581243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d22fa6d5-6e3f-411b-af84-cb3ed91fd2eb tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.156861 Jul 14 20:42:50.581806 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 464/936] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:50 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:51.598602 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:51.599241 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:51.606392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:51.606838 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:51.607632 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:51.608075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:51.740692 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:51.748236 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b2e21bee-2407-4ceb-b1c4-cf78a8d3e23b tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.153498 Jul 14 20:42:51.748789 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 473/937] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:51 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:52.765125 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:52.765737 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:52.772598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:52.773043 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:52.774421 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:52.774863 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:52.908468 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:52.916020 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-07c8d310-35dc-48e1-98ae-b77bc7a3fac8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.154723 Jul 14 20:42:52.916595 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 465/938] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:52 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:53.931869 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:53.932509 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:53.939242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:53.939693 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:53.940489 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:53.940924 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:54.073493 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:54.081060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9ecd3caa-8aec-42a6-9caa-d09669f3de67 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.153085 Jul 14 20:42:54.081627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 474/939] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:53 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:54.983637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-3b236edf-dc7e-4181-9f0b-19710096b3d1 req-14daf7ba-b9cf-4701-98e6-0ecddd9aa22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61a7eb-3c48-4e25-91b7-93ba228b1082", "name": "network-vif-plugged", "status": "completed", "tag": "da21b590-1f64-4742-b37a-d9aa9698c268"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:54.993287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3b236edf-dc7e-4181-9f0b-19710096b3d1 req-14daf7ba-b9cf-4701-98e6-0ecddd9aa22e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:54.994430 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3b236edf-dc7e-4181-9f0b-19710096b3d1 req-14daf7ba-b9cf-4701-98e6-0ecddd9aa22e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:54.998787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:42:55.009402 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-3b236edf-dc7e-4181-9f0b-19710096b3d1 req-14daf7ba-b9cf-4701-98e6-0ecddd9aa22e service nova] Creating event network-vif-plugged:da21b590-1f64-4742-b37a-d9aa9698c268 for instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 on hv-cinder-79987 Jul 14 20:42:55.014790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-3b236edf-dc7e-4181-9f0b-19710096b3d1 req-14daf7ba-b9cf-4701-98e6-0ecddd9aa22e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034788 Jul 14 20:42:55.015478 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 466/940] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:55.097779 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:55.098373 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:55.105399 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:55.105853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:55.106653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:55.107121 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:55.255374 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:55.262969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-71bde548-13ac-4dce-b3ad-2942840e4060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.169134 Jul 14 20:42:55.263526 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 475/941] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:55 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:56.280959 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:56.281657 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:56.288222 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:56.288667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:56.289717 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:56.290227 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:56.420957 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:56.429210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-48bfcb5f-fb66-42e1-b7ce-54199fc67916 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1257 microversion: 2.1 time: 0.153014 Jul 14 20:42:56.429773 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 467/942] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:56 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:57.446790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:57.447429 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:57.453910 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:57.454369 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:57.455187 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:57.455628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:57.588448 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:57.596107 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f783ca9e-b02a-48f1-9e5e-e88c7debefe8 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1442 microversion: 2.1 time: 0.153237 Jul 14 20:42:57.596932 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 476/943] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:57 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:57.613114 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:42:57.613718 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:57.620357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:57.620802 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:57.621570 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:57.622000 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:57.759275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:42:57.766971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-7d16d8ad-20ee-4ffc-bcdb-fb73d8a1bfa5 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1442 microversion: 2.1 time: 0.157612 Jul 14 20:42:57.767557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 468/944] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:42:57 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:42:58.865836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-de2dbc0b-b738-4081-9d7c-9b9642d9864a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fa76af-9d66-4167-b1c9-9c3320827829", "device": "/dev/sdb"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:58.868124 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-de2dbc0b-b738-4081-9d7c-9b9642d9864a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:42:58.874511 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de2dbc0b-b738-4081-9d7c-9b9642d9864a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:58.874985 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de2dbc0b-b738-4081-9d7c-9b9642d9864a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:58.875757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de2dbc0b-b738-4081-9d7c-9b9642d9864a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:58.876192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-de2dbc0b-b738-4081-9d7c-9b9642d9864a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:59.134498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-de2dbc0b-b738-4081-9d7c-9b9642d9864a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "POST /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272480 Jul 14 20:42:59.135177 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 477/945] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:42:58 2022] POST /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:42:59.477673 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-6d40e6fa-8574-4b98-aac4-e849be8cf11a req-144a6ab1-f65d-4569-9d70-87970d8b0948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a61a7eb-3c48-4e25-91b7-93ba228b1082", "tag": "da21b590-1f64-4742-b37a-d9aa9698c268"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:42:59.487092 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-6d40e6fa-8574-4b98-aac4-e849be8cf11a req-144a6ab1-f65d-4569-9d70-87970d8b0948 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:42:59.487689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-6d40e6fa-8574-4b98-aac4-e849be8cf11a req-144a6ab1-f65d-4569-9d70-87970d8b0948 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:42:59.500337 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-6d40e6fa-8574-4b98-aac4-e849be8cf11a req-144a6ab1-f65d-4569-9d70-87970d8b0948 service nova] Creating event network-changed:da21b590-1f64-4742-b37a-d9aa9698c268 for instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 on hv-cinder-79987 Jul 14 20:42:59.505708 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-6d40e6fa-8574-4b98-aac4-e849be8cf11a req-144a6ab1-f65d-4569-9d70-87970d8b0948 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032670 Jul 14 20:42:59.506320 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 469/946] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:22.782596 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=15 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:22.783394 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:22.787779 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:22.788354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:22.796282 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:22.796722 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:22.797487 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:22.797918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:22.882196 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lazy-loading 'services' on Instance uuid e953341a-d18f-4927-9e2f-2e3990f8959b {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:43:22.952857 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f3ac79d1-23b8-44ee-bf8d-606fcb5a1fc0 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b/os-volume_attachments/e9fa76af-9d66-4167-b1c9-9c3320827829" status: 202 len: 0 microversion: 2.1 time: 0.171587 Jul 14 20:43:22.953612 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 478/947] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:43:22 2022] DELETE /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b/os-volume_attachments/e9fa76af-9d66-4167-b1c9-9c3320827829 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:43:25.118322 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=19 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:25.119144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=14 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:25.123839 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:25.124413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:25.131345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:25.131786 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:25.132539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:25.132972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:25.158571 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:43:25.237103 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-25d4010e-1b4b-447a-874f-c7230e9a1b5b tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 204 len: 0 microversion: 2.1 time: 0.119351 Jul 14 20:43:25.237929 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 470/948] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:43:25 2022] DELETE /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:43:25.248335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:25.249067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:25.256193 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:25.256649 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:25.257428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:25.257876 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:25.388582 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:25.396713 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4c343903-e7e6-4202-ad1d-e7fdd43fa001 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1514 microversion: 2.1 time: 0.153892 Jul 14 20:43:25.397288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 479/949] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:25 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:26.414181 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:26.414883 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:26.421388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:26.421847 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:26.422629 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:26.423101 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:26.558225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:26.565856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c997aa52-05c5-4f92-b31b-8ed9d197c741 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1514 microversion: 2.1 time: 0.155981 Jul 14 20:43:26.566419 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 471/950] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:26 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:27.582498 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:27.583134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:27.590298 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:27.590750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:27.591570 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:27.592011 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:27.723570 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:27.731802 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-21a1c015-bf42-4df4-96c7-0bdf6b43b6b1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1514 microversion: 2.1 time: 0.153206 Jul 14 20:43:27.732363 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 480/951] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:27 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:28.355922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-4d10d15b-ffaf-46c1-8a22-c74849d39680 req-b61e95f5-c8a2-4b8a-af7d-97483d7f2b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e953341a-d18f-4927-9e2f-2e3990f8959b", "name": "network-vif-deleted", "tag": "8da29d94-af65-43ce-a17a-e89f96b50b93"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:28.364633 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-4d10d15b-ffaf-46c1-8a22-c74849d39680 req-b61e95f5-c8a2-4b8a-af7d-97483d7f2b87 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:28.365076 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-4d10d15b-ffaf-46c1-8a22-c74849d39680 req-b61e95f5-c8a2-4b8a-af7d-97483d7f2b87 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:28.377004 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-4d10d15b-ffaf-46c1-8a22-c74849d39680 req-b61e95f5-c8a2-4b8a-af7d-97483d7f2b87 service nova] Creating event network-vif-deleted:8da29d94-af65-43ce-a17a-e89f96b50b93 for instance e953341a-d18f-4927-9e2f-2e3990f8959b on hv-cinder-79987 Jul 14 20:43:28.381778 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-4d10d15b-ffaf-46c1-8a22-c74849d39680 req-b61e95f5-c8a2-4b8a-af7d-97483d7f2b87 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029630 Jul 14 20:43:28.382606 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 472/952] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:28.749262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:28.749866 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:28.756244 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:28.756694 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:28.757480 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:28.757916 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:28.790335 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:28.790789 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:28.791273 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lazy-loading 'fault' on Instance uuid e953341a-d18f-4927-9e2f-2e3990f8959b {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:43:28.832549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:28.840294 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-595735b3-16ff-4168-9144-b5851efafc21 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 200 len: 1309 microversion: 2.1 time: 0.095500 Jul 14 20:43:28.840842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 481/953] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:28 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:29.862345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:29.863069 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: e953341a-d18f-4927-9e2f-2e3990f8959b] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:29.872168 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:29.872654 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:29.873439 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:29.873879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:29.893510 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] HTTP exception thrown: Instance e953341a-d18f-4927-9e2f-2e3990f8959b could not be found. Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Request method failure captured: Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b HTTP/1.1 Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H-yJwPcp59s5wxfEjuMq0DktXY8sWKfA4elFi6eoJmm50li3d10Yt6vLSPNauvsjp_pM20Vkc1TjF_A9jwDou94cgAAsj49ugStqpT2cXCwJo5ItJ1X6Nrq5FydX9UnA_822VBZjQblunsOGTeeDW9iuGil8Ek3ojiOvkcCGiLl_F0 Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: d2fb85822f104b7a981279226f8f1aa6 Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-VolumesSnapshotTestJSON-680297148 Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:43:29.895194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2fb85822f104b7a981279226f8f1aa6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2fb85822f104b7a981279226f8f1aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2fb85822f104b7a981279226f8f1aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2fb85822f104b7a981279226f8f1aa6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-VolumesSnapshotTestJSON-680297148 Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: d2fb85822f104b7a981279226f8f1aa6 Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-680297148 Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-VolumesSnapshotTestJSON-680297148-project Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: aa4214b07ad54de69e689254dfc99eb3 Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-VolumesSnapshotTestJSON-680297148-project Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance e953341a-d18f-4927-9e2f-2e3990f8959b could not be found. Jul 14 20:43:29.896939 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'e953341a-d18f-4927-9e2f-2e3990f8959b'} Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e953341a-d18f-4927-9e2f-2e3990f8959b could not be found. Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:43:29.897951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e953341a-d18f-4927-9e2f-2e3990f8959b could not be found. Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e953341a-d18f-4927-9e2f-2e3990f8959b could not be found. Jul 14 20:43:29.899727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:43:29.900999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Returning 404 to user: Instance e953341a-d18f-4927-9e2f-2e3990f8959b could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:43:29.900999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c64e9390-9017-4a8b-a92e-5c3484b021c1 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b" status: 404 len: 111 microversion: 2.1 time: 0.041031 Jul 14 20:43:29.900999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 473/954] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:29 2022] GET /compute/v2.1/servers/e953341a-d18f-4927-9e2f-2e3990f8959b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:43:34.413916 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3ad4a403-f3c6-4ab9-b6a3-49cac818e187 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:34.414842 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3ad4a403-f3c6-4ab9-b6a3-49cac818e187 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:34.421009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ad4a403-f3c6-4ab9-b6a3-49cac818e187 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:34.421463 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ad4a403-f3c6-4ab9-b6a3-49cac818e187 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:34.422233 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ad4a403-f3c6-4ab9-b6a3-49cac818e187 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:34.422671 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3ad4a403-f3c6-4ab9-b6a3-49cac818e187 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:34.453492 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3ad4a403-f3c6-4ab9-b6a3-49cac818e187 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043607 Jul 14 20:43:34.454038 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 482/955] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:43:34 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 20:43:34.510888 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:34.511462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:34.517913 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:34.518622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:34.519417 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:34.519855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:34.551401 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:43:34.637391 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-699bb162-1064-438c-9013-15954bca4317 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 204 len: 0 microversion: 2.1 time: 0.129841 Jul 14 20:43:34.638008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 474/956] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:43:34 2022] DELETE /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:43:34.648217 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:34.648829 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:34.654864 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:34.655354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:34.656123 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:34.656567 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:34.784444 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:34.791890 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-a9a7cb57-1085-4b32-9c89-9bd0c6515db5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1671 microversion: 2.1 time: 0.149013 Jul 14 20:43:34.792442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 483/957] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:34 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:35.810383 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:35.811109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:35.818016 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:35.818461 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:35.819264 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:35.819724 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:35.950792 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:35.958399 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-d464afa5-b9cb-4947-9c23-4a4c253c0be1 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1671 microversion: 2.1 time: 0.152722 Jul 14 20:43:35.959019 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 475/958] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:35 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:36.975647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:36.976186 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:36.982679 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:36.983160 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:36.983921 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:36.984357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:37.113747 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:37.121698 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-3e3b7518-21fc-49d3-bc81-89205c088ca8 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1671 microversion: 2.1 time: 0.149553 Jul 14 20:43:37.122272 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 484/959] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:36 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:38.138182 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:38.138775 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:38.145790 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:38.146239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:38.147024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:38.147462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:38.281338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:38.288910 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-44258a8f-e2d9-42ae-a494-42311ec5b973 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1671 microversion: 2.1 time: 0.154563 Jul 14 20:43:38.289473 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 476/960] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:38 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:39.305616 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:39.306222 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:39.313284 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:39.313733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:39.314494 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:39.314947 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:39.530269 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:39.537807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-b72a405f-b749-4a77-a0c0-b925c6c3c493 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1671 microversion: 2.1 time: 0.235996 Jul 14 20:43:39.538471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 485/961] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:39 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1671 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:39.710081 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-236424542", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "networks": [{"uuid": "33641e48-7817-4fd4-b018-04fb34fd9d08"}]}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:39.762974 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] validate_networks() for [('33641e48-7817-4fd4-b018-04fb34fd9d08', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:43:40.351234 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:43:40.351660 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:43:40.352133 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:43:40.352548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:43:40.352955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:43:40.362451 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:40.362898 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:40.363734 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:40.364187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:40.381233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Getting quotas for project d2fb85822f104b7a981279226f8f1aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:43:40.385188 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Getting quotas for user aa4214b07ad54de69e689254dfc99eb3 and project d2fb85822f104b7a981279226f8f1aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:43:40.396704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:43:40.398962 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:43:40.447226 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2d74d447-876d-45ad-a3b1-453d3c9bcbc2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740768 Jul 14 20:43:40.448233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 477/962] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:43:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:43:40.459970 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-ba84f07a-205f-4213-a7e5-525e16602c8a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:40.460619 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-ba84f07a-205f-4213-a7e5-525e16602c8a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:40.555932 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:40.556718 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:40.564861 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:40.565727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:40.566634 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:40.567382 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:40.785262 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-ba84f07a-205f-4213-a7e5-525e16602c8a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:40.787402 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:40.800401 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-ba84f07a-205f-4213-a7e5-525e16602c8a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1218 microversion: 2.1 time: 0.344389 Jul 14 20:43:40.802963 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 486/963] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:40 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1218 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:40.813725 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-30209736-35a9-4cf9-a43b-f9ed8f2ee296 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 200 len: 1605 microversion: 2.1 time: 0.261923 Jul 14 20:43:40.814526 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 478/964] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:40 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:40.884924 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-00f71b2c-6699-4cce-bdbf-816272abf013 req-f0577151-459d-494b-b3d9-fb8dee30b594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fcf2cb-a1b4-4e88-83ba-1fdecb056836", "name": "network-vif-deleted", "tag": "7aec5355-7bd2-42ec-8e1e-613974fa243f"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:40.897568 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-00f71b2c-6699-4cce-bdbf-816272abf013 req-f0577151-459d-494b-b3d9-fb8dee30b594 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:40.898017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-00f71b2c-6699-4cce-bdbf-816272abf013 req-f0577151-459d-494b-b3d9-fb8dee30b594 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:40.909940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-00f71b2c-6699-4cce-bdbf-816272abf013 req-f0577151-459d-494b-b3d9-fb8dee30b594 service nova] Creating event network-vif-deleted:7aec5355-7bd2-42ec-8e1e-613974fa243f for instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 on hv-cinder-79987 Jul 14 20:43:40.915357 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-00f71b2c-6699-4cce-bdbf-816272abf013 req-f0577151-459d-494b-b3d9-fb8dee30b594 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035133 Jul 14 20:43:40.916054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 487/965] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:41.820198 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:41.820895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:41.828356 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:41.829056 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:41.830002 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:41.830675 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:41.834643 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:41.835375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:41.847084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:41.848134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:41.849106 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:41.849625 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:41.872310 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] HTTP exception thrown: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Request method failure captured: Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 HTTP/1.1 Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H8mZI-oVpKxmVi27KcTDO1u5l-W9w8pcUzJOtYD8ykfg_IYPLPD8qP8QAvKj60bAia_clnC9_2cInBbDjAf-wymWKDD583DGMfZW6oXM-ztaufUF1PsITNCGkDPTTJoc_P8Y-mIiN02y8_LKbP4iq1yGzNdTUUpcipX9mdP_lxNfmI Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:43:41.874574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01d544a1fa8b4ac08d4588eab1a84ff5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 813a2d3222f54b18a4322174a409183e Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:43:41.876242 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'e1fcf2cb-a1b4-4e88-83ba-1fdecb056836'} Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:43:41.877075 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:43:41.878392 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:43:41.880552 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Returning 404 to user: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:43:41.880552 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-805011b1-2dda-46dd-9051-bfbafefcd9c5 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 404 len: 111 microversion: 2.1 time: 0.048479 Jul 14 20:43:41.881533 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 488/966] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:41 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:43:41.887958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-e3467a52-f40f-46c3-a83a-3c426834419a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '.version_select at 0x7fafb19af940>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:41.918690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-e3467a52-f40f-46c3-a83a-3c426834419a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624968022" status: 202 len: 0 microversion: 2.1 time: 0.035962 Jul 14 20:43:41.919747 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 489/967] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 14 20:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624968022 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:43:41.924433 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:41.936706 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c25f7608-0cd8-460f-bdc1-e492e7f1847d tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1270 microversion: 2.1 time: 0.120152 Jul 14 20:43:41.938794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 479/968] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:41 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1270 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:42.593719 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-50f3c3e1-570c-400a-847c-4e7faa31f7c2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'create', calling method: .version_select at 0x7fafb17a5820>, body: {"keypair": {"name": "tempest-keypair-175225543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4+kHLwq4IXoebl9bF1VULA5twu296jFY7iUNNnqFlvXWYb2PrffJuDywRxR0GlAh8uw7nPJpKsJiWd3ddDLnBlDEwgrakFLs5cyb7L9u9/qN2HZvOaEWdpYj+5cInc9w=="}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:42.609145 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-50f3c3e1-570c-400a-847c-4e7faa31f7c2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:43:42.613051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.quota [None req-50f3c3e1-570c-400a-847c-4e7faa31f7c2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for user 813a2d3222f54b18a4322174a409183e and project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'key_pairs'} {{(pid=124370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:43:42.639417 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-50f3c3e1-570c-400a-847c-4e7faa31f7c2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050837 Jul 14 20:43:42.640017 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 490/969] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 14 20:43:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:42.956302 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:42.957525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:42.964187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:42.964645 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:42.966030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:42.966475 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:43.175951 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:43.186689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f522e069-22a4-4479-b024-0712b83df2b8 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.234308 Jul 14 20:43:43.197801 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 480/970] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:42 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:43.407712 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-24966e5e-04dd-43bb-9d85-4c9c5f7c05b0 req-54be4da1-65a3-4614-a712-37a94053bb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26608afe-5952-4105-b7c2-ac62add60d17", "tag": "37b66eca-6834-4178-be9a-4743da089833"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:43.419932 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-24966e5e-04dd-43bb-9d85-4c9c5f7c05b0 req-54be4da1-65a3-4614-a712-37a94053bb91 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:43.420907 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-24966e5e-04dd-43bb-9d85-4c9c5f7c05b0 req-54be4da1-65a3-4614-a712-37a94053bb91 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:43.439609 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-24966e5e-04dd-43bb-9d85-4c9c5f7c05b0 req-54be4da1-65a3-4614-a712-37a94053bb91 service nova] Creating event network-changed:37b66eca-6834-4178-be9a-4743da089833 for instance 26608afe-5952-4105-b7c2-ac62add60d17 on hv-cinder-79987 Jul 14 20:43:43.445340 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-24966e5e-04dd-43bb-9d85-4c9c5f7c05b0 req-54be4da1-65a3-4614-a712-37a94053bb91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043788 Jul 14 20:43:43.446414 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 491/971] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:43.974358 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1313488868", "imageRef": "37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70ed2e9a-e979-4363-9c81-646389ddfcce"}], "security_groups": [{"name": "tempest-securitygroup--619079277"}], "key_name": "tempest-keypair-175225543", "user_data": "}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:44.119087 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.network.neutron [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] validate_networks() for [('70ed2e9a-e979-4363-9c81-646389ddfcce', None, None, None, None, None)] {{(pid=124371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 20:43:44.205393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:44.206116 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:44.212378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:44.212827 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:44.213600 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:44.214035 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:44.435078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:44.443610 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-daea7920-323b-4024-8a43-9dd150efb5b2 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.242062 Jul 14 20:43:44.444180 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 492/972] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:44 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:44.554084 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Flavor limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 20:43:44.554464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Image limits 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 20:43:44.554954 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Flavor pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 20:43:44.555371 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Image pref 0:0:0 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 20:43:44.555786 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.virt.hardware [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 20:43:44.565102 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:44.565553 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:44.566357 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:44.566791 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:44.583617 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 20:43:44.587353 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.quota [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Getting quotas for user 813a2d3222f54b18a4322174a409183e and project 01d544a1fa8b4ac08d4588eab1a84ff5. Resources: {'ram', 'cores', 'instances'} {{(pid=124371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 20:43:44.598191 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Going to run 1 instances... {{(pid=124371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 20:43:44.600328 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37d8b1f0-d4d8-4c8c-b771-ff6a53fdb722',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 20:43:44.646121 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-46f68454-67c3-4339-b6dc-6a3e0ed66acb tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676124 Jul 14 20:43:44.646766 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 481/973] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 14 20:43:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 20:43:44.656753 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-deb9824a-7215-45c1-b3af-a04a9a2e9892 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:44.657375 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-deb9824a-7215-45c1-b3af-a04a9a2e9892 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:44.717737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-deb9824a-7215-45c1-b3af-a04a9a2e9892 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:44.726279 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-deb9824a-7215-45c1-b3af-a04a9a2e9892 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1237 microversion: 2.1 time: 0.073366 Jul 14 20:43:44.727007 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 493/974] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:44 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:43:45.460961 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:45.461610 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:45.468338 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:45.468897 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:45.469704 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:45.470144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:45.598653 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:45.606195 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3e37bd9a-f59d-4f21-b5eb-8be0790dde0a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.149683 Jul 14 20:43:45.607329 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 482/975] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:45 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:45.743416 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:45.744191 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:45.754264 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:45.754875 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:45.755806 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:45.756353 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:45.892721 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:45.905131 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1437d9b6-58d5-47bf-9635-411ea7a8f228 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1297 microversion: 2.1 time: 0.165591 Jul 14 20:43:45.905847 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 494/976] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:45 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1297 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:46.624392 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:46.625036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:46.632047 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:46.632698 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:46.633877 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:46.634444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:46.842823 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:46.851247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4fa546d9-2f36-45aa-b214-75b30e825973 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.231431 Jul 14 20:43:46.851828 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 483/977] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:46 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:46.922149 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:46.922755 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:46.929188 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:46.929641 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:46.930407 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:46.930840 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:47.147306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:47.156980 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9ce75927-0c18-454b-acd1-2f5dce7702b0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1362 microversion: 2.1 time: 0.239078 Jul 14 20:43:47.157467 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 495/978] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:46 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:47.744024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-59d49327-08eb-40ac-a70c-27822a3f1759 req-6b26655f-2d75-4974-8764-a41114101230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df8bb1f-8413-44e5-85da-15527cbc031a", "tag": "93c680a6-8f98-4177-87b0-3a5603a602e7"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:47.756480 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-59d49327-08eb-40ac-a70c-27822a3f1759 req-6b26655f-2d75-4974-8764-a41114101230 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:47.757379 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-59d49327-08eb-40ac-a70c-27822a3f1759 req-6b26655f-2d75-4974-8764-a41114101230 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:47.788610 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-59d49327-08eb-40ac-a70c-27822a3f1759 req-6b26655f-2d75-4974-8764-a41114101230 service nova] Creating event network-changed:93c680a6-8f98-4177-87b0-3a5603a602e7 for instance 0df8bb1f-8413-44e5-85da-15527cbc031a on hv-cinder-79987 Jul 14 20:43:47.794720 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-59d49327-08eb-40ac-a70c-27822a3f1759 req-6b26655f-2d75-4974-8764-a41114101230 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055343 Jul 14 20:43:47.795494 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 484/979] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:47.870131 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:47.870742 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:47.877902 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:47.878367 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:47.879202 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:47.879651 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:48.097309 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:48.105054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-bd9c527e-89d3-4f93-af39-86ef50d4cb9c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.238689 Jul 14 20:43:48.106437 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 496/980] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:47 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:48.174976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:48.175692 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:48.182017 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:48.182473 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:48.183275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:48.183725 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:48.638466 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:48.648902 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6c2f4c01-c560-4cdc-9911-0f952c2cbac3 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1362 microversion: 2.1 time: 0.478310 Jul 14 20:43:48.650098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 485/981] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:48 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:49.123377 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:49.124022 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:49.130428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:49.130879 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:49.131679 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:49.132121 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:49.265529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:49.273084 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8962a645-e614-4b0d-9c84-9fb5a268f2de tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.154087 Jul 14 20:43:49.273679 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 497/982] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:49 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:49.381442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-47dbb654-4ae6-4e59-8794-8724e375dd16 req-72a868c4-289c-461e-8004-bb448abcd194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26608afe-5952-4105-b7c2-ac62add60d17", "name": "network-vif-plugged", "status": "completed", "tag": "37b66eca-6834-4178-be9a-4743da089833"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:49.392502 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-47dbb654-4ae6-4e59-8794-8724e375dd16 req-72a868c4-289c-461e-8004-bb448abcd194 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:49.393808 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-47dbb654-4ae6-4e59-8794-8724e375dd16 req-72a868c4-289c-461e-8004-bb448abcd194 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:49.407658 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-47dbb654-4ae6-4e59-8794-8724e375dd16 req-72a868c4-289c-461e-8004-bb448abcd194 service nova] Creating event network-vif-plugged:37b66eca-6834-4178-be9a-4743da089833 for instance 26608afe-5952-4105-b7c2-ac62add60d17 on hv-cinder-79987 Jul 14 20:43:49.412601 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-47dbb654-4ae6-4e59-8794-8724e375dd16 req-72a868c4-289c-461e-8004-bb448abcd194 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034963 Jul 14 20:43:49.413198 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 486/983] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:43:49.666365 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:49.666994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:49.673506 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:49.673952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:49.674716 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:49.675208 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:49.941101 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:49.948872 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-849bf55e-c25c-4e87-a1f6-b76d1e574cae tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1362 microversion: 2.1 time: 0.287057 Jul 14 20:43:49.949586 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 498/984] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:49 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:50.290123 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:50.290824 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:50.297711 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:50.298160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:50.298944 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:50.299397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:50.303459 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:50.466099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:50.473574 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-85738c0e-7256-4155-8be3-63a55281d17a tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.187689 Jul 14 20:43:50.474144 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 487/985] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:50 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:50.966488 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:50.967153 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:50.973760 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:50.974211 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:50.975021 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:50.975459 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:50.993647 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:51.121737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:51.129486 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4364ee49-a504-40fe-8280-3cfa957a8688 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1362 microversion: 2.1 time: 0.167443 Jul 14 20:43:51.130046 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 499/986] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:50 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:51.490644 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:51.491295 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:51.497856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:51.498306 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:51.499116 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:51.499563 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:51.630739 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:51.638591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-60510f25-788c-4b02-b295-6d64659570bd tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1318 microversion: 2.1 time: 0.151796 Jul 14 20:43:51.639187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 488/987] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:51 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:52.147145 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:52.147690 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:52.154501 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:52.154965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:52.155780 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:52.156223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:52.283628 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:52.291129 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-aab8fc08-8c1c-46ef-b196-ef6e5c1eac9a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1362 microversion: 2.1 time: 0.148242 Jul 14 20:43:52.291680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 500/988] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:52 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:52.656123 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:52.657038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:52.664347 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:52.664798 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:52.665569 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:52.666005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:52.800980 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:52.808448 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-61f9c32d-f166-4346-a189-494923214ad4 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1508 microversion: 2.1 time: 0.156579 Jul 14 20:43:52.809650 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 489/989] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:52 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:52.825442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-da754de8-b1de-4bdc-9569-6c69ec25a0a5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0117a6a-c3eb-41a5-acbc-a509859d1203", "device": "/dev/sdb"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:52.826529 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-da754de8-b1de-4bdc-9569-6c69ec25a0a5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:52.828469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:52.833894 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-da754de8-b1de-4bdc-9569-6c69ec25a0a5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:52.834348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-da754de8-b1de-4bdc-9569-6c69ec25a0a5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:52.835157 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-da754de8-b1de-4bdc-9569-6c69ec25a0a5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:52.835598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-da754de8-b1de-4bdc-9569-6c69ec25a0a5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:53.084698 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-da754de8-b1de-4bdc-9569-6c69ec25a0a5 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "POST /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263233 Jul 14 20:43:53.085303 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 501/990] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:43:52 2022] POST /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:53.308718 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:53.309910 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:53.316083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:53.316544 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:53.317444 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:53.317883 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:53.417994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-9b76d328-bdbd-46f0-a5e6-d6e01ba0cd4f req-673a215b-41b9-4a95-843d-c3fb23a79c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df8bb1f-8413-44e5-85da-15527cbc031a", "name": "network-vif-plugged", "status": "completed", "tag": "93c680a6-8f98-4177-87b0-3a5603a602e7"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:53.427920 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-9b76d328-bdbd-46f0-a5e6-d6e01ba0cd4f req-673a215b-41b9-4a95-843d-c3fb23a79c1a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:53.428370 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-9b76d328-bdbd-46f0-a5e6-d6e01ba0cd4f req-673a215b-41b9-4a95-843d-c3fb23a79c1a service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:53.441992 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-9b76d328-bdbd-46f0-a5e6-d6e01ba0cd4f req-673a215b-41b9-4a95-843d-c3fb23a79c1a service nova] Creating event network-vif-plugged:93c680a6-8f98-4177-87b0-3a5603a602e7 for instance 0df8bb1f-8413-44e5-85da-15527cbc031a on hv-cinder-79987 Jul 14 20:43:53.447574 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-9b76d328-bdbd-46f0-a5e6-d6e01ba0cd4f req-673a215b-41b9-4a95-843d-c3fb23a79c1a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Jul 14 20:43:53.448666 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 502/991] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:43:53.452965 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:53.462696 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-2577c913-9b6a-415a-8eb0-6f4a319e5700 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1362 microversion: 2.1 time: 0.158552 Jul 14 20:43:53.463464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 490/992] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:53 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:54.480475 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:54.481836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:54.488597 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:54.489055 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:54.489837 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:54.490286 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:54.620611 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:54.628275 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4be67ed6-6033-461b-bcd3-aa90fd0cd90b tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1362 microversion: 2.1 time: 0.152056 Jul 14 20:43:54.628837 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 503/993] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:54 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:55.645389 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:55.645999 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:55.648334 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=4 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:55.649013 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell0:SELECT=12 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:55.649753 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:55.656039 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:55.656488 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:55.657267 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:55.657703 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:55.789917 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:43:55.798249 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-00041331-b7ae-46fd-9073-8fc644f8b459 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1549 microversion: 2.1 time: 0.157025 Jul 14 20:43:55.798829 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 491/994] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:43:55 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:43:55.815676 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0b2ea20a-762b-4ced-9283-4eb744b6dfb4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:43:55.816210 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0b2ea20a-762b-4ced-9283-4eb744b6dfb4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:43:55.818228 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell0:SELECT=8 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:43:55.824164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0b2ea20a-762b-4ced-9283-4eb744b6dfb4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:55.824617 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0b2ea20a-762b-4ced-9283-4eb744b6dfb4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:55.825390 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0b2ea20a-762b-4ced-9283-4eb744b6dfb4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:55.825825 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0b2ea20a-762b-4ced-9283-4eb744b6dfb4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:55.908762 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0b2ea20a-762b-4ced-9283-4eb744b6dfb4 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096998 Jul 14 20:43:55.909354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 504/995] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 14 20:43:55 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:43:56.839198 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-3e156e2b-a96a-4476-bcbc-7bb46e79db0e req-51da07f0-46dc-4267-957b-68e03a045cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df8bb1f-8413-44e5-85da-15527cbc031a", "tag": "93c680a6-8f98-4177-87b0-3a5603a602e7"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:43:56.848609 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3e156e2b-a96a-4476-bcbc-7bb46e79db0e req-51da07f0-46dc-4267-957b-68e03a045cc0 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:43:56.849057 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-3e156e2b-a96a-4476-bcbc-7bb46e79db0e req-51da07f0-46dc-4267-957b-68e03a045cc0 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:43:56.861159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-3e156e2b-a96a-4476-bcbc-7bb46e79db0e req-51da07f0-46dc-4267-957b-68e03a045cc0 service nova] Creating event network-changed:93c680a6-8f98-4177-87b0-3a5603a602e7 for instance 0df8bb1f-8413-44e5-85da-15527cbc031a on hv-cinder-79987 Jul 14 20:43:56.866212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-3e156e2b-a96a-4476-bcbc-7bb46e79db0e req-51da07f0-46dc-4267-957b-68e03a045cc0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030713 Jul 14 20:43:56.867100 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 492/996] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:12.398315 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=7 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:12.399159 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:12.403144 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:12.403660 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:12.411266 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:12.411715 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:12.412484 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:12.412922 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:12.493937 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lazy-loading 'services' on Instance uuid 26608afe-5952-4105-b7c2-ac62add60d17 {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:44:12.566096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-850ef740-ed49-4cee-a834-3080711655d3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "DELETE /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17/os-volume_attachments/b0117a6a-c3eb-41a5-acbc-a509859d1203" status: 202 len: 0 microversion: 2.1 time: 0.168684 Jul 14 20:44:12.566858 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 505/997] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:44:12 2022] DELETE /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17/os-volume_attachments/b0117a6a-c3eb-41a5-acbc-a509859d1203 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:44:13.743036 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:13.743789 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=30 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:13.748289 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:13.748867 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:13.756378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:13.756820 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:13.757579 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:13.758008 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:13.782673 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:44:13.857585 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9e8db308-7e8a-4f71-a2e8-4e599c164714 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "DELETE /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 204 len: 0 microversion: 2.1 time: 0.115812 Jul 14 20:44:13.858178 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 493/998] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:44:13 2022] DELETE /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:44:13.869045 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:13.869750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:13.876267 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:13.876767 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:13.877594 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:13.878704 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:14.011430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:14.019166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-53ec92ef-7fbb-44e6-bbf1-c14aba9bde43 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1514 microversion: 2.1 time: 0.154665 Jul 14 20:44:14.019734 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 506/999] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:13 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:44:15.037007 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:15.037701 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:15.044520 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:15.044970 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:15.045728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:15.046189 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:15.175690 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:15.183615 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3625daf3-25e8-4ed7-8da2-d2916dab2a7c tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1514 microversion: 2.1 time: 0.150832 Jul 14 20:44:15.184179 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 494/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:15 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:16.200959 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:16.201590 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:16.208898 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:16.209356 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:16.210148 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:16.210587 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:16.420882 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4214b07ad54de69e689254dfc99eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fb85822f104b7a981279226f8f1aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:16.430113 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-6a453a2e-1ac2-4532-92e2-dbf587892de3 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 200 len: 1514 microversion: 2.1 time: 0.232949 Jul 14 20:44:16.430847 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 507/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:16 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:16.474091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-7db817f8-4718-4779-a27e-8798acd0a51d req-0d7a6df4-6da5-4098-a5ff-3d9b4a88cb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26608afe-5952-4105-b7c2-ac62add60d17", "name": "network-vif-deleted", "tag": "37b66eca-6834-4178-be9a-4743da089833"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:44:16.482760 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-7db817f8-4718-4779-a27e-8798acd0a51d req-0d7a6df4-6da5-4098-a5ff-3d9b4a88cb4e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:16.483169 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-7db817f8-4718-4779-a27e-8798acd0a51d req-0d7a6df4-6da5-4098-a5ff-3d9b4a88cb4e service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:16.494187 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-7db817f8-4718-4779-a27e-8798acd0a51d req-0d7a6df4-6da5-4098-a5ff-3d9b4a88cb4e service nova] Creating event network-vif-deleted:37b66eca-6834-4178-be9a-4743da089833 for instance 26608afe-5952-4105-b7c2-ac62add60d17 on hv-cinder-79987 Jul 14 20:44:16.499109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-7db817f8-4718-4779-a27e-8798acd0a51d req-0d7a6df4-6da5-4098-a5ff-3d9b4a88cb4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028620 Jul 14 20:44:16.499597 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 495/1002] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:17.448378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:17.448925 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] [instance: 26608afe-5952-4105-b7c2-ac62add60d17] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:17.455549 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:17.455997 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:17.456762 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:17.457223 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:17.471431 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] HTTP exception thrown: Instance 26608afe-5952-4105-b7c2-ac62add60d17 could not be found. Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Request method failure captured: Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 HTTP/1.1 Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H-yJwPcp59s5wxfEjuMq0DktXY8sWKfA4elFi6eoJmm50li3d10Yt6vLSPNauvsjp_pM20Vkc1TjF_A9jwDou94cgAAsj49ugStqpT2cXCwJo5ItJ1X6Nrq5FydX9UnA_822VBZjQblunsOGTeeDW9iuGil8Ek3ojiOvkcCGiLl_F0 Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: d2fb85822f104b7a981279226f8f1aa6 Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-VolumesSnapshotTestJSON-680297148 Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:44:17.473070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2fb85822f104b7a981279226f8f1aa6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2fb85822f104b7a981279226f8f1aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2fb85822f104b7a981279226f8f1aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2fb85822f104b7a981279226f8f1aa6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-VolumesSnapshotTestJSON-680297148 Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: d2fb85822f104b7a981279226f8f1aa6 Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-680297148 Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-VolumesSnapshotTestJSON-680297148-project Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: aa4214b07ad54de69e689254dfc99eb3 Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-VolumesSnapshotTestJSON-680297148-project Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 26608afe-5952-4105-b7c2-ac62add60d17 could not be found. Jul 14 20:44:17.475395 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '26608afe-5952-4105-b7c2-ac62add60d17'} Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26608afe-5952-4105-b7c2-ac62add60d17 could not be found. Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:44:17.476324 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26608afe-5952-4105-b7c2-ac62add60d17 could not be found. Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26608afe-5952-4105-b7c2-ac62add60d17 could not be found. Jul 14 20:44:17.477940 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:17.479276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] Returning 404 to user: Instance 26608afe-5952-4105-b7c2-ac62add60d17 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:44:17.479276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-0d640dfa-6c67-4ca4-9db6-24acb274d772 tempest-VolumesSnapshotTestJSON-680297148 tempest-VolumesSnapshotTestJSON-680297148-project] 10.222.0.52 "GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17" status: 404 len: 111 microversion: 2.1 time: 0.031341 Jul 14 20:44:17.479276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 508/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:17 2022] GET /compute/v2.1/servers/26608afe-5952-4105-b7c2-ac62add60d17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:44:23.176306 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-2303e06b-480f-4cd1-8fc7-025f65ef4d9f req-ceee36ca-95fe-47fa-b28f-2702d3e55068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8", "tag": "888019b8-69f1-44bf-b3ed-5afda837d4b0"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:44:23.179945 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:23.180532 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:23.194286 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:23.194731 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:23.196668 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-2303e06b-480f-4cd1-8fc7-025f65ef4d9f req-ceee36ca-95fe-47fa-b28f-2702d3e55068 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:23.197112 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-2303e06b-480f-4cd1-8fc7-025f65ef4d9f req-ceee36ca-95fe-47fa-b28f-2702d3e55068 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:23.201691 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:23.202482 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:23.215653 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-2303e06b-480f-4cd1-8fc7-025f65ef4d9f req-ceee36ca-95fe-47fa-b28f-2702d3e55068 service nova] Creating event network-changed:888019b8-69f1-44bf-b3ed-5afda837d4b0 for instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 on hv-cinder-79987 Jul 14 20:44:23.224795 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-2303e06b-480f-4cd1-8fc7-025f65ef4d9f req-ceee36ca-95fe-47fa-b28f-2702d3e55068 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051548 Jul 14 20:44:23.226710 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 509/1004] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:23.233261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:44:23.328516 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-6b16df79-5b00-4cde-bcf8-9462a8a7f309 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 204 len: 0 microversion: 2.1 time: 0.158294 Jul 14 20:44:23.334551 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 496/1005] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:44:23 2022] DELETE /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:44:23.341470 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:23.342206 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:23.355679 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:23.356428 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:23.357412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:23.358038 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:23.520322 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:23.528410 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-970dc74d-32a4-4d30-ad4b-d90e10854581 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1579 microversion: 2.1 time: 0.191887 Jul 14 20:44:23.529208 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 510/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:23 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:24.552106 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:24.552106 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:24.562869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:24.563233 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:24.564021 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:24.564637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:24.727402 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:24.734977 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8aad58c1-8c52-478b-af5d-5488a8b512b9 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1579 microversion: 2.1 time: 0.191655 Jul 14 20:44:24.735550 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 497/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:24 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1579 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:25.755010 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:25.756334 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:25.762979 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:25.763430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:25.764224 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:25.764660 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:25.967770 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-833e891b-b5d0-4cb4-977b-c64347957e01 req-4bfb7b3d-6586-410d-be84-1fbf7f64878d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8", "name": "network-vif-deleted", "tag": "888019b8-69f1-44bf-b3ed-5afda837d4b0"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:44:25.992640 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-833e891b-b5d0-4cb4-977b-c64347957e01 req-4bfb7b3d-6586-410d-be84-1fbf7f64878d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:25.995141 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-833e891b-b5d0-4cb4-977b-c64347957e01 req-4bfb7b3d-6586-410d-be84-1fbf7f64878d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:25.995706 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:26.006174 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9653b07e-98e9-45d3-9500-e471d6b9ee2f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1460 microversion: 2.1 time: 0.256386 Jul 14 20:44:26.006802 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 511/1008] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:25 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1460 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:26.013761 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-833e891b-b5d0-4cb4-977b-c64347957e01 req-4bfb7b3d-6586-410d-be84-1fbf7f64878d service nova] Creating event network-vif-deleted:888019b8-69f1-44bf-b3ed-5afda837d4b0 for instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 on hv-cinder-79987 Jul 14 20:44:26.019119 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-833e891b-b5d0-4cb4-977b-c64347957e01 req-4bfb7b3d-6586-410d-be84-1fbf7f64878d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054819 Jul 14 20:44:26.019749 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 498/1009] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:44:27.023739 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:27.024368 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:27.030806 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:27.031288 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:27.032070 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:27.032508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:27.069646 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:27.070116 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:27.070615 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lazy-loading 'fault' on Instance uuid b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:44:27.128263 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:27.135515 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c7f81985-f12f-4b83-83a3-21928af8942f tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 200 len: 1185 microversion: 2.1 time: 0.115641 Jul 14 20:44:27.136093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 512/1010] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:27 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 1185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:28.153834 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:28.154452 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:28.160725 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:28.161175 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:28.161944 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:28.162382 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:28.175655 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] HTTP exception thrown: Instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 could not be found. Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Request method failure captured: Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 HTTP/1.1 Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H5PbOvH48jKWxZzxYWsNCAJyVHGhuC6J0YrVco_RN4MH1n6NHHT5UIczVQKBr7AWSpciOPPWm7jeXUiJNfNpC-qGdTQ8GdCKP3oQARzxPkTyCOPJSriYf734botd6ibjl8cWFOHk9MtLQeXNDCriAI1VTtarrBK3ZlC5BXj12ZXNqw Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:44:28.177764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83a29cbfb7484b76a9131a3b81832c62", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 6502e3ffa3b84333a00ea5f712767d61 Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 could not be found. Jul 14 20:44:28.180237 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8'} Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 could not be found. Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:44:28.181687 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 could not be found. Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 could not be found. Jul 14 20:44:28.184388 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:28.186869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Returning 404 to user: Instance b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:44:28.186869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e64e6c8a-c6b2-4c4e-a837-c58e48c7225b tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8" status: 404 len: 111 microversion: 2.1 time: 0.030093 Jul 14 20:44:28.186869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 499/1011] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:28 2022] GET /compute/v2.1/servers/b28c39b4-0dfd-4880-bfd1-f6d2a3f016b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:44:33.381861 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:33.382960 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:33.383964 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-32e966d5-25de-4765-ad71-41b12e1046d7 req-f2b25b67-fda7-4c83-878d-7a3b1f09d13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8165ae1-4719-48d2-9171-41ee878766c2", "tag": "9d7cb7f5-d312-41e5-b399-d59c90177499"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:44:33.389199 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:33.390276 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:33.391097 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:33.391537 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:33.394727 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-32e966d5-25de-4765-ad71-41b12e1046d7 req-f2b25b67-fda7-4c83-878d-7a3b1f09d13b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:33.395327 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-32e966d5-25de-4765-ad71-41b12e1046d7 req-f2b25b67-fda7-4c83-878d-7a3b1f09d13b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:33.411005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-32e966d5-25de-4765-ad71-41b12e1046d7 req-f2b25b67-fda7-4c83-878d-7a3b1f09d13b service nova] Creating event network-changed:9d7cb7f5-d312-41e5-b399-d59c90177499 for instance d8165ae1-4719-48d2-9171-41ee878766c2 on hv-cinder-79987 Jul 14 20:44:33.416342 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-32e966d5-25de-4765-ad71-41b12e1046d7 req-f2b25b67-fda7-4c83-878d-7a3b1f09d13b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036885 Jul 14 20:44:33.417078 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 500/1012] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:44:33.421492 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:44:33.508733 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dc1fdebb-1344-4124-8fae-f41f863fb56c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 204 len: 0 microversion: 2.1 time: 0.131609 Jul 14 20:44:33.509331 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 513/1013] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:44:33 2022] DELETE /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:44:33.521720 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:33.522430 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:33.529092 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:33.529779 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:33.530764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:33.531235 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:33.708014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:33.715793 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c5a2a70d-3035-4daa-8262-d77db8f4cd08 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1580 microversion: 2.1 time: 0.201408 Jul 14 20:44:33.716401 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 501/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:33 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1580 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:34.733514 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:34.734230 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:34.741166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:34.741615 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:34.742380 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:34.742813 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:34.919906 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:34.928300 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f106b27f-b820-451a-aee6-b8712728a64c tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1580 microversion: 2.1 time: 0.198979 Jul 14 20:44:34.928909 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 514/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:34 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1580 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:35.906826 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-9e643be2-7d18-47eb-b1b8-16bf6c19a63c req-ec570816-8223-465c-83bf-eaab272ca20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8165ae1-4719-48d2-9171-41ee878766c2", "name": "network-vif-deleted", "tag": "9d7cb7f5-d312-41e5-b399-d59c90177499"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:44:35.916674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-9e643be2-7d18-47eb-b1b8-16bf6c19a63c req-ec570816-8223-465c-83bf-eaab272ca20b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:35.917105 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-9e643be2-7d18-47eb-b1b8-16bf6c19a63c req-ec570816-8223-465c-83bf-eaab272ca20b service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:35.931540 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-9e643be2-7d18-47eb-b1b8-16bf6c19a63c req-ec570816-8223-465c-83bf-eaab272ca20b service nova] Creating event network-vif-deleted:9d7cb7f5-d312-41e5-b399-d59c90177499 for instance d8165ae1-4719-48d2-9171-41ee878766c2 on hv-cinder-79987 Jul 14 20:44:35.937300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-9e643be2-7d18-47eb-b1b8-16bf6c19a63c req-ec570816-8223-465c-83bf-eaab272ca20b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033936 Jul 14 20:44:35.937909 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 502/1016] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:35.946543 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:35.947190 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:35.953707 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:35.954163 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:35.955026 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:35.955412 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:36.020382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502e3ffa3b84333a00ea5f712767d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a29cbfb7484b76a9131a3b81832c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:44:36.028723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-77fef9d2-d078-48e5-a0f7-2343f4b5b086 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 200 len: 1226 microversion: 2.1 time: 0.086582 Jul 14 20:44:36.029560 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 515/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:35 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:44:37.046303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:37.047007 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: d8165ae1-4719-48d2-9171-41ee878766c2] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:37.054150 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:37.054598 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:37.055384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:37.055820 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:37.069402 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] HTTP exception thrown: Instance d8165ae1-4719-48d2-9171-41ee878766c2 could not be found. Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Request method failure captured: Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 HTTP/1.1 Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H5PbOvH48jKWxZzxYWsNCAJyVHGhuC6J0YrVco_RN4MH1n6NHHT5UIczVQKBr7AWSpciOPPWm7jeXUiJNfNpC-qGdTQ8GdCKP3oQARzxPkTyCOPJSriYf734botd6ibjl8cWFOHk9MtLQeXNDCriAI1VTtarrBK3ZlC5BXj12ZXNqw Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:44:37.071026 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83a29cbfb7484b76a9131a3b81832c62", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 6502e3ffa3b84333a00ea5f712767d61 Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance d8165ae1-4719-48d2-9171-41ee878766c2 could not be found. Jul 14 20:44:37.072664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'd8165ae1-4719-48d2-9171-41ee878766c2'} Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8165ae1-4719-48d2-9171-41ee878766c2 could not be found. Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:44:37.073565 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8165ae1-4719-48d2-9171-41ee878766c2 could not be found. Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8165ae1-4719-48d2-9171-41ee878766c2 could not be found. Jul 14 20:44:37.075158 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.076511 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Returning 404 to user: Instance d8165ae1-4719-48d2-9171-41ee878766c2 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:44:37.076511 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-152a5db3-8327-493e-adc0-40c253a68354 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2" status: 404 len: 111 microversion: 2.1 time: 0.030386 Jul 14 20:44:37.076511 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 503/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:37 2022] GET /compute/v2.1/servers/d8165ae1-4719-48d2-9171-41ee878766c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:44:37.522229 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:37.522762 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:37.529345 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:37.529807 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:37.530585 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:37.531054 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:37.544585 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] HTTP exception thrown: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Request method failure captured: Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: DELETE /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 HTTP/1.1 Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H5PbOvH48jKWxZzxYWsNCAJyVHGhuC6J0YrVco_RN4MH1n6NHHT5UIczVQKBr7AWSpciOPPWm7jeXUiJNfNpC-qGdTQ8GdCKP3oQARzxPkTyCOPJSriYf734botd6ibjl8cWFOHk9MtLQeXNDCriAI1VTtarrBK3ZlC5BXj12ZXNqw Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:44:37.546254 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83a29cbfb7484b76a9131a3b81832c62", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 6502e3ffa3b84333a00ea5f712767d61 Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.547880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'b3f144a8-c1b4-424d-80f0-da744bd56947'} Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:44:37.548783 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.550051 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.551598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Returning 404 to user: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:44:37.551598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-968be251-8158-4b7b-b76b-1633d5a30b5a tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 404 len: 111 microversion: 2.1 time: 0.029747 Jul 14 20:44:37.551598 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 516/1019] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:44:37 2022] DELETE /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:44:37.557032 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:37.557639 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] [instance: b3f144a8-c1b4-424d-80f0-da744bd56947] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:37.563791 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:37.564243 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:37.565014 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:37.565459 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:37.578794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] HTTP exception thrown: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Request method failure captured: Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 HTTP/1.1 Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H5PbOvH48jKWxZzxYWsNCAJyVHGhuC6J0YrVco_RN4MH1n6NHHT5UIczVQKBr7AWSpciOPPWm7jeXUiJNfNpC-qGdTQ8GdCKP3oQARzxPkTyCOPJSriYf734botd6ibjl8cWFOHk9MtLQeXNDCriAI1VTtarrBK3ZlC5BXj12ZXNqw Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:44:37.580378 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83a29cbfb7484b76a9131a3b81832c62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83a29cbfb7484b76a9131a3b81832c62", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 83a29cbfb7484b76a9131a3b81832c62 Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-TestVolumeBootPattern-955624271 Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 6502e3ffa3b84333a00ea5f712767d61 Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-TestVolumeBootPattern-955624271-project Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.581981 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': 'b3f144a8-c1b4-424d-80f0-da744bd56947'} Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:44:37.582856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. Jul 14 20:44:37.584878 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:44:37.586067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Returning 404 to user: Instance b3f144a8-c1b4-424d-80f0-da744bd56947 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:44:37.586067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-54c76aed-b445-4429-b70e-ca5b601d0eb7 tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947" status: 404 len: 111 microversion: 2.1 time: 0.029240 Jul 14 20:44:37.586067 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 504/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:44:37 2022] GET /compute/v2.1/servers/b3f144a8-c1b4-424d-80f0-da744bd56947 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:44:38.875623 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-cfab0f84-dfed-4230-afb8-2aa1481238af tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] Calling method '.version_select at 0x7fafb17d3700>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:38.897694 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-cfab0f84-dfed-4230-afb8-2aa1481238af tempest-TestVolumeBootPattern-955624271 tempest-TestVolumeBootPattern-955624271-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1335986240" status: 202 len: 0 microversion: 2.1 time: 0.025284 Jul 14 20:44:38.898930 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 517/1021] 10.222.0.52 () {58 vars in 1262 bytes} [Thu Jul 14 20:44:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1335986240 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:44:48.171078 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:44:48.171728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Thu Jul 14 20:44:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:44:49.070526 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:49.071302 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:49.075137 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ba0714c4-2e4d-4181-8e2d-21793b0181e2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:49.075657 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ba0714c4-2e4d-4181-8e2d-21793b0181e2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:49.082860 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba0714c4-2e4d-4181-8e2d-21793b0181e2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:49.083345 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba0714c4-2e4d-4181-8e2d-21793b0181e2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:49.084109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba0714c4-2e4d-4181-8e2d-21793b0181e2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:49.084550 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ba0714c4-2e4d-4181-8e2d-21793b0181e2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:49.107716 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ba0714c4-2e4d-4181-8e2d-21793b0181e2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/ips" status: 200 len: 147 microversion: 2.1 time: 0.038962 Jul 14 20:44:49.108275 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 505/1022] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 14 20:44:49 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:50.428799 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-94093ad1-30bb-4309-9fc1-e51038df3f2c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f9a6434-2f4c-4adb-8de0-6f52aaf184ba"}} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:44:50.429884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-94093ad1-30bb-4309-9fc1-e51038df3f2c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:50.432390 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:50.433032 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:44:50.439258 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-94093ad1-30bb-4309-9fc1-e51038df3f2c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:50.439743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-94093ad1-30bb-4309-9fc1-e51038df3f2c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:50.440523 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-94093ad1-30bb-4309-9fc1-e51038df3f2c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:50.440963 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-94093ad1-30bb-4309-9fc1-e51038df3f2c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:51.082037 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-94093ad1-30bb-4309-9fc1-e51038df3f2c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658446 Jul 14 20:44:51.082645 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 518/1023] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:44:50 2022] POST /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:53.200182 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:44:53.200764 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Thu Jul 14 20:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:44:58.567780 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f10e5b2a-9a40-4899-bf45-ab749b8fc3d2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:58.569204 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f10e5b2a-9a40-4899-bf45-ab749b8fc3d2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:58.576679 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f10e5b2a-9a40-4899-bf45-ab749b8fc3d2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:58.576955 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f10e5b2a-9a40-4899-bf45-ab749b8fc3d2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:58.577726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f10e5b2a-9a40-4899-bf45-ab749b8fc3d2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:58.578159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f10e5b2a-9a40-4899-bf45-ab749b8fc3d2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:58.608700 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f10e5b2a-9a40-4899-bf45-ab749b8fc3d2 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Jul 14 20:44:58.609247 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 506/1024] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:44:58 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:58.621156 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-03797c9a-9d47-4eab-93d5-f1825a32eb3a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:44:58.621719 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-03797c9a-9d47-4eab-93d5-f1825a32eb3a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:58.628082 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03797c9a-9d47-4eab-93d5-f1825a32eb3a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:58.628530 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03797c9a-9d47-4eab-93d5-f1825a32eb3a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:58.629296 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03797c9a-9d47-4eab-93d5-f1825a32eb3a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:58.629735 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-03797c9a-9d47-4eab-93d5-f1825a32eb3a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:58.660127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-03797c9a-9d47-4eab-93d5-f1825a32eb3a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/4f9a6434-2f4c-4adb-8de0-6f52aaf184ba" status: 200 len: 194 microversion: 2.1 time: 0.043658 Jul 14 20:44:58.660728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 519/1025] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jul 14 20:44:58 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/4f9a6434-2f4c-4adb-8de0-6f52aaf184ba => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:44:59.969024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-1b0b7665-f57e-4bfc-8b57-0418a7f8730a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e1fe995-01ce-4f25-9136-80f005b86b4a"}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:44:59.970076 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-1b0b7665-f57e-4bfc-8b57-0418a7f8730a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:44:59.976726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b0b7665-f57e-4bfc-8b57-0418a7f8730a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:59.977350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b0b7665-f57e-4bfc-8b57-0418a7f8730a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:44:59.977350 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b0b7665-f57e-4bfc-8b57-0418a7f8730a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:44:59.978336 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-1b0b7665-f57e-4bfc-8b57-0418a7f8730a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:00.284413 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-1b0b7665-f57e-4bfc-8b57-0418a7f8730a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "POST /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318959 Jul 14 20:45:00.285009 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 507/1026] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 14 20:44:59 2022] POST /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:45:07.882903 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-bfcb74a9-781a-4aa2-ada8-bd0e7228e6ce tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:07.883964 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-bfcb74a9-781a-4aa2-ada8-bd0e7228e6ce tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:07.890717 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfcb74a9-781a-4aa2-ada8-bd0e7228e6ce tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:07.891202 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfcb74a9-781a-4aa2-ada8-bd0e7228e6ce tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:07.891982 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfcb74a9-781a-4aa2-ada8-bd0e7228e6ce tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:07.892713 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-bfcb74a9-781a-4aa2-ada8-bd0e7228e6ce tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:07.928305 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-bfcb74a9-781a-4aa2-ada8-bd0e7228e6ce tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049251 Jul 14 20:45:07.928882 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 520/1027] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:45:07 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:45:08.075811 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f7107d98-1d07-4b7a-9770-12c80e02a83e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:08.076409 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f7107d98-1d07-4b7a-9770-12c80e02a83e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:08.083638 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7107d98-1d07-4b7a-9770-12c80e02a83e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:08.084160 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7107d98-1d07-4b7a-9770-12c80e02a83e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:08.085496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7107d98-1d07-4b7a-9770-12c80e02a83e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:08.086205 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f7107d98-1d07-4b7a-9770-12c80e02a83e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:08.116970 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f7107d98-1d07-4b7a-9770-12c80e02a83e tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/4f9a6434-2f4c-4adb-8de0-6f52aaf184ba" status: 200 len: 194 microversion: 2.1 time: 0.045625 Jul 14 20:45:08.117576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 508/1028] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jul 14 20:45:08 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/4f9a6434-2f4c-4adb-8de0-6f52aaf184ba => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:45:08.127441 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:08.127936 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:08.134762 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:08.135170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:08.135958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:08.136397 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:08.226450 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lazy-loading 'services' on Instance uuid 0df8bb1f-8413-44e5-85da-15527cbc031a {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:45:08.310009 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-90ff694b-84a2-4e30-b739-4c366124a942 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/4f9a6434-2f4c-4adb-8de0-6f52aaf184ba" status: 202 len: 0 microversion: 2.1 time: 0.186425 Jul 14 20:45:08.310888 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 521/1029] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:45:08 2022] DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/4f9a6434-2f4c-4adb-8de0-6f52aaf184ba => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:45:09.455922 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ab678e07-6299-4734-80a4-7b1bcd2079ed tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:09.456546 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ab678e07-6299-4734-80a4-7b1bcd2079ed tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:09.463788 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab678e07-6299-4734-80a4-7b1bcd2079ed tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:09.464261 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab678e07-6299-4734-80a4-7b1bcd2079ed tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:09.465021 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab678e07-6299-4734-80a4-7b1bcd2079ed tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:09.465454 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ab678e07-6299-4734-80a4-7b1bcd2079ed tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:09.494451 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ab678e07-6299-4734-80a4-7b1bcd2079ed tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/5e1fe995-01ce-4f25-9136-80f005b86b4a" status: 200 len: 194 microversion: 2.1 time: 0.042423 Jul 14 20:45:09.495063 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 509/1030] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jul 14 20:45:09 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/5e1fe995-01ce-4f25-9136-80f005b86b4a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:45:09.505735 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:09.506871 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:09.513711 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:09.514171 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:09.514982 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:09.515438 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:09.598797 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lazy-loading 'services' on Instance uuid 0df8bb1f-8413-44e5-85da-15527cbc031a {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:45:09.671727 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-fcf03c36-26e6-48bd-9b33-5e5009a8c076 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/5e1fe995-01ce-4f25-9136-80f005b86b4a" status: 202 len: 0 microversion: 2.1 time: 0.170298 Jul 14 20:45:09.672409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 522/1031] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 14 20:45:09 2022] DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments/5e1fe995-01ce-4f25-9136-80f005b86b4a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:45:10.831935 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-ad578bce-c392-4d42-b09b-f1a691286cb0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:10.832908 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-ad578bce-c392-4d42-b09b-f1a691286cb0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:10.839478 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad578bce-c392-4d42-b09b-f1a691286cb0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:10.839930 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad578bce-c392-4d42-b09b-f1a691286cb0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:10.840697 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad578bce-c392-4d42-b09b-f1a691286cb0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:10.841135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-ad578bce-c392-4d42-b09b-f1a691286cb0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:10.870589 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-ad578bce-c392-4d42-b09b-f1a691286cb0 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042635 Jul 14 20:45:10.871220 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 510/1032] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:45:10 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 20:45:10.982393 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-16d55b39-b1d8-4d31-b697-73ea04d3e2b9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:10.983445 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-16d55b39-b1d8-4d31-b697-73ea04d3e2b9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:10.989817 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16d55b39-b1d8-4d31-b697-73ea04d3e2b9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:10.990834 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16d55b39-b1d8-4d31-b697-73ea04d3e2b9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:10.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16d55b39-b1d8-4d31-b697-73ea04d3e2b9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:10.992071 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-16d55b39-b1d8-4d31-b697-73ea04d3e2b9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.020488 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-16d55b39-b1d8-4d31-b697-73ea04d3e2b9 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042802 Jul 14 20:45:11.021029 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 523/1033] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 14 20:45:10 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 20:45:11.078154 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:11.078677 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:11.084740 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.085191 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.085956 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.086402 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.110964 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Going to try to terminate instance {{(pid=124371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:45:11.191044 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-4e2c1672-0681-4259-9990-6fef77a38794 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 204 len: 0 microversion: 2.1 time: 0.116359 Jul 14 20:45:11.191869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 511/1034] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:45:11 2022] DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:45:11.200687 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:11.201303 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:11.207337 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.207792 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.208557 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.209028 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.249210 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:45:11.249834 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:11.256166 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.256622 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.257405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.257843 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.281674 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.objects.instance [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lazy-loading 'flavor' on Instance uuid 2a61a7eb-3c48-4e25-91b7-93ba228b1082 {{(pid=124371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:45:11.348836 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:11.357140 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-d49f6269-cb3f-4b7b-9e5e-308009dd385d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1674 microversion: 2.1 time: 0.160334 Jul 14 20:45:11.357994 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 524/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:11 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:11.393213 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f351f48a-fc11-44ad-b1fb-bc611563333c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "POST /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082/action" status: 202 len: 0 microversion: 2.1 time: 0.148000 Jul 14 20:45:11.393813 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 512/1036] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:45:11 2022] POST /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 20:45:11.402877 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:11.403518 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:11.409640 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.410091 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.410859 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:11.412890 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:11.546192 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:11.553743 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-54599fc4-2969-4469-9a26-eb6e2d2c289e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.154694 Jul 14 20:45:11.554334 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 525/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:11 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:12.375732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:12.376421 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:12.384159 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:12.384603 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:12.385372 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:12.385805 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:12.541816 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:12.550300 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3392a052-b881-43c9-9b50-3eeb31419d23 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1674 microversion: 2.1 time: 0.179295 Jul 14 20:45:12.550929 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 513/1038] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:12 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:45:12.571452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:12.572060 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:12.578750 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:12.579234 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:12.580019 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:12.580458 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:12.724308 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:12.739031 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f3aad2cb-fe6f-4694-b5a5-bb6abd6d6b8a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.171326 Jul 14 20:45:12.739711 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 526/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:12 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:13.569818 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:13.570442 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:13.577023 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:13.577486 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:13.578260 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:13.578705 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:13.759259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:13.759877 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:13.770157 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:13.770551 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:13.771853 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:13.772293 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:13.815399 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:13.823024 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-3c47c1b9-a6e0-4007-bfe6-50fc8b4f4373 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1674 microversion: 2.1 time: 0.257200 Jul 14 20:45:13.823604 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 514/1040] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:13 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:14.290721 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:14.298312 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-10d5b69d-8199-4937-a81a-f6b4a5e0895a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.544446 Jul 14 20:45:14.298892 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 527/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:13 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:45:14.481787 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-2d05ee4b-84e5-4d73-a889-60ebc1cdef9b req-b63944dc-50dd-44cb-9dc7-2589d0c10afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df8bb1f-8413-44e5-85da-15527cbc031a", "name": "network-vif-deleted", "tag": "93c680a6-8f98-4177-87b0-3a5603a602e7"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:45:14.493888 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-2d05ee4b-84e5-4d73-a889-60ebc1cdef9b req-b63944dc-50dd-44cb-9dc7-2589d0c10afa service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:14.494697 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-2d05ee4b-84e5-4d73-a889-60ebc1cdef9b req-b63944dc-50dd-44cb-9dc7-2589d0c10afa service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:14.507856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-2d05ee4b-84e5-4d73-a889-60ebc1cdef9b req-b63944dc-50dd-44cb-9dc7-2589d0c10afa service nova] Creating event network-vif-deleted:93c680a6-8f98-4177-87b0-3a5603a602e7 for instance 0df8bb1f-8413-44e5-85da-15527cbc031a on hv-cinder-79987 Jul 14 20:45:14.513028 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-2d05ee4b-84e5-4d73-a889-60ebc1cdef9b req-b63944dc-50dd-44cb-9dc7-2589d0c10afa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108972 Jul 14 20:45:14.513625 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 515/1042] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:45:14.844354 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:14.845581 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:14.853801 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:14.854400 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:14.855061 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:14.855504 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:14.888134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:14.888430 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:14.889067 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.objects.instance [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lazy-loading 'fault' on Instance uuid 0df8bb1f-8413-44e5-85da-15527cbc031a {{(pid=124370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 20:45:14.936580 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '813a2d3222f54b18a4322174a409183e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d544a1fa8b4ac08d4588eab1a84ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:14.945902 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-01b5d999-c855-4330-8d9a-74899bf87eff tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 200 len: 1327 microversion: 2.1 time: 0.107999 Jul 14 20:45:14.947144 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 528/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:14 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:15.316835 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:15.317287 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:15.324548 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:15.325004 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:15.325792 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:15.326229 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:15.466432 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:15.475119 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-b185d77a-c15a-425b-a97d-0a4cf4ccb092 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.162657 Jul 14 20:45:15.475748 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 516/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:15 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:15.964207 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:15.964942 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:15.971597 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:15.972049 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:15.972820 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:15.973259 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:15.987096 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] HTTP exception thrown: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Request method failure captured: Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a HTTP/1.1 Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H8mZI-oVpKxmVi27KcTDO1u5l-W9w8pcUzJOtYD8ykfg_IYPLPD8qP8QAvKj60bAia_clnC9_2cInBbDjAf-wymWKDD583DGMfZW6oXM-ztaufUF1PsITNCGkDPTTJoc_P8Y-mIiN02y8_LKbP4iq1yGzNdTUUpcipX9mdP_lxNfmI Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:45:15.988737 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01d544a1fa8b4ac08d4588eab1a84ff5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 813a2d3222f54b18a4322174a409183e Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:15.990483 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': '0df8bb1f-8413-44e5-85da-15527cbc031a'} Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:45:15.991637 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:15.993250 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:15.994740 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Returning 404 to user: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:45:15.994740 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-5552dfa0-6371-4442-8700-695376a32f13 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 404 len: 111 microversion: 2.1 time: 0.029851 Jul 14 20:45:15.994740 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 529/1045] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:15 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:45:15.999313 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e1865cb4-cd9e-4b89-9444-51922e60443c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '.version_select at 0x7fafb1e9baf0>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:16.026428 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e1865cb4-cd9e-4b89-9444-51922e60443c tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175225543" status: 202 len: 0 microversion: 2.1 time: 0.031129 Jul 14 20:45:16.027035 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 517/1046] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Jul 14 20:45:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175225543 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:45:16.493073 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:16.493723 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:16.499790 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:16.500282 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:16.501011 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:16.501509 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:16.722607 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:16.731200 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-43e21820-28b2-485f-9d17-216db2fc12df tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.242141 Jul 14 20:45:16.731971 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 530/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:16 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:17.749664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:17.750440 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:17.758034 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:17.758606 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:17.759443 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:17.759884 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:17.782091 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:45:17.902576 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:17.910162 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-f6926cf3-40de-43cb-b9cd-6f6dc28f1022 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.164967 Jul 14 20:45:17.910729 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 518/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:17 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:18.928206 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:18.928751 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:18.935409 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:18.935861 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:18.936626 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:18.937068 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:19.011490 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:19.012303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:19.018868 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:19.019726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:19.020656 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:19.021167 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:19.036946 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] HTTP exception thrown: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Request method failure captured: Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a HTTP/1.1 Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H8mZI-oVpKxmVi27KcTDO1u5l-W9w8pcUzJOtYD8ykfg_IYPLPD8qP8QAvKj60bAia_clnC9_2cInBbDjAf-wymWKDD583DGMfZW6oXM-ztaufUF1PsITNCGkDPTTJoc_P8Y-mIiN02y8_LKbP4iq1yGzNdTUUpcipX9mdP_lxNfmI Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:45:19.039303 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01d544a1fa8b4ac08d4588eab1a84ff5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 813a2d3222f54b18a4322174a409183e Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.040728 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '0df8bb1f-8413-44e5-85da-15527cbc031a'} Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:45:19.041539 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.043212 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.044969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Returning 404 to user: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:45:19.044969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-e4d491af-0f64-4b9f-8b65-dc93216e564a tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 404 len: 111 microversion: 2.1 time: 0.033185 Jul 14 20:45:19.044969 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 519/1049] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:45:19 2022] DELETE /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:45:19.048972 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:19.049578 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: 0df8bb1f-8413-44e5-85da-15527cbc031a] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:19.055450 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:19.055905 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:19.056683 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:19.057122 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:19.070583 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] HTTP exception thrown: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Request method failure captured: Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a HTTP/1.1 Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H8mZI-oVpKxmVi27KcTDO1u5l-W9w8pcUzJOtYD8ykfg_IYPLPD8qP8QAvKj60bAia_clnC9_2cInBbDjAf-wymWKDD583DGMfZW6oXM-ztaufUF1PsITNCGkDPTTJoc_P8Y-mIiN02y8_LKbP4iq1yGzNdTUUpcipX9mdP_lxNfmI Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:45:19.072173 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01d544a1fa8b4ac08d4588eab1a84ff5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: 813a2d3222f54b18a4322174a409183e Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.073812 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '0df8bb1f-8413-44e5-85da-15527cbc031a'} Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:45:19.074750 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. Jul 14 20:45:19.076437 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:45:19.077870 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Returning 404 to user: Instance 0df8bb1f-8413-44e5-85da-15527cbc031a could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:45:19.077870 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-89e13ccc-5105-4652-9fd9-04d64f1d8e46 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a" status: 404 len: 111 microversion: 2.1 time: 0.028228 Jul 14 20:45:19.079268 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 520/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:19 2022] GET /compute/v2.1/servers/0df8bb1f-8413-44e5-85da-15527cbc031a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 20:45:19.079581 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:19.088095 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-8c90fd48-7924-4a4f-af6e-bf81aeba7acf tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.163822 Jul 14 20:45:19.088771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 531/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:18 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:45:20.107157 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:20.107795 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:20.110133 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:45:20.117552 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:20.118006 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:20.118855 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:20.119333 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:20.216396 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:20.217015 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:20.224351 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:20.224871 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:20.225681 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:20.226194 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:20.231014 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:45:20.242918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] HTTP exception thrown: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Request method failure captured: Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: DELETE /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 HTTP/1.1 Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H8mZI-oVpKxmVi27KcTDO1u5l-W9w8pcUzJOtYD8ykfg_IYPLPD8qP8QAvKj60bAia_clnC9_2cInBbDjAf-wymWKDD583DGMfZW6oXM-ztaufUF1PsITNCGkDPTTJoc_P8Y-mIiN02y8_LKbP4iq1yGzNdTUUpcipX9mdP_lxNfmI Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:45:20.245093 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01d544a1fa8b4ac08d4588eab1a84ff5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 813a2d3222f54b18a4322174a409183e Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.247327 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'e1fcf2cb-a1b4-4e88-83ba-1fdecb056836'} Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:45:20.248378 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.250166 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.251936 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Returning 404 to user: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:45:20.252476 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-81e8d01c-002a-43ce-a8e0-dc83f4217c48 tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 404 len: 111 microversion: 2.1 time: 0.041845 Jul 14 20:45:20.253163 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 532/1052] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:45:20 2022] DELETE /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:45:20.262330 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:20.262996 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] [instance: e1fcf2cb-a1b4-4e88-83ba-1fdecb056836] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:20.267373 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:20.271470 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:20.272004 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:20.272794 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:20.273909 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:20.276102 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-05cb8e03-c1ec-4995-8729-0cbf96705ba6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.173160 Jul 14 20:45:20.276686 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 521/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:20 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:20.292782 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.wsgi [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] HTTP exception thrown: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Request method failure captured: Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: request: GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 HTTP/1.1 Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept: application/json Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Accept-Encoding: identity Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Connection: close Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Length: 0 Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Content-Type: application/json Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Host: 10.222.0.52 Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Openstack-System-Scope: None Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: User-Agent: python-urllib3/1.26.9 Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Auth-Token: gAAAAABi0H8mZI-oVpKxmVi27KcTDO1u5l-W9w8pcUzJOtYD8ykfg_IYPLPD8qP8QAvKj60bAia_clnC9_2cInBbDjAf-wymWKDD583DGMfZW6oXM-ztaufUF1PsITNCGkDPTTJoc_P8Y-mIiN02y8_LKbP4iq1yGzNdTUUpcipX9mdP_lxNfmI Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Id: None Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Domain-Name: None Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Identity-Status: Confirmed Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Is-Admin-Project: True Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Id: default Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Domain-Name: Default Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Project-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Role: reader,member Jul 14 20:45:20.294452 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Roles: reader,member Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01d544a1fa8b4ac08d4588eab1a84ff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01d544a1fa8b4ac08d4588eab1a84ff5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Id: 01d544a1fa8b4ac08d4588eab1a84ff5 Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1632954796 Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Id: default Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Domain-Name: Default Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Id: 813a2d3222f54b18a4322174a409183e Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: X-User-Name: tempest-AttachVolumeTestJSON-1632954796-project Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: method: > Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: exception: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.296554 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: action_args: {'id': 'e1fcf2cb-a1b4-4e88-83ba-1fdecb056836'} Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:45:20.297884 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. Jul 14 20:45:20.299891 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: ERROR nova.api.openstack.wsgi Jul 14 20:45:20.301496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] Returning 404 to user: Instance e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 could not be found. {{(pid=124370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:45:20.301496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-62392d1e-e468-445a-aa4d-c8a60433a85d tempest-AttachVolumeTestJSON-1632954796 tempest-AttachVolumeTestJSON-1632954796-project] 10.222.0.52 "GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836" status: 404 len: 111 microversion: 2.1 time: 0.038608 Jul 14 20:45:20.301496 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 533/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:20 2022] GET /compute/v2.1/servers/e1fcf2cb-a1b4-4e88-83ba-1fdecb056836 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:45:21.293438 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:21.294031 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:21.301432 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:21.301885 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:21.302819 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:21.303976 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:21.547678 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:21.555376 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-a0c42fc8-5957-42ed-8572-76454008d72d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.265765 Jul 14 20:45:21.556040 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 522/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:21 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:22.573442 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:22.574059 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:22.576478 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=35 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:45:22.582406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:22.582880 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:22.583888 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:22.584325 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:22.738010 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:22.746349 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-c27068fd-9018-4887-8c54-03539dc964f6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.177431 Jul 14 20:45:22.746974 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 534/1056] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:22 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:23.764397 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:23.764937 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:23.772066 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:23.772507 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:23.773809 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:23.774239 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:23.920523 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:23.928525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-8fe6377c-4856-4f49-a8c6-1f85b981eb0e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.168052 Jul 14 20:45:23.935170 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 523/1057] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:23 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:24.946153 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:24.946900 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:24.953435 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:24.953943 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:24.954683 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:24.955164 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:25.097761 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:25.106948 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-84bec003-7a98-4ad3-b667-8ae46dcf423a tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.165145 Jul 14 20:45:25.107584 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 535/1058] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:24 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:26.124803 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:26.125496 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:26.132564 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:26.133208 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:26.134367 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:26.135012 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:26.295616 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:26.303326 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-caeb8318-b65f-47f1-af82-ce266788d36d tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1507 microversion: 2.1 time: 0.182318 Jul 14 20:45:26.303888 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 524/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:26 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:26.320636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-dda5b947-1eb1-499c-a991-ccebd78d51b6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:45:26.321229 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-dda5b947-1eb1-499c-a991-ccebd78d51b6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:26.328976 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dda5b947-1eb1-499c-a991-ccebd78d51b6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:26.329800 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dda5b947-1eb1-499c-a991-ccebd78d51b6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:26.330599 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dda5b947-1eb1-499c-a991-ccebd78d51b6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:26.331126 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-dda5b947-1eb1-499c-a991-ccebd78d51b6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:26.413414 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-dda5b947-1eb1-499c-a991-ccebd78d51b6 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "POST /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082/action" status: 202 len: 0 microversion: 2.1 time: 0.097118 Jul 14 20:45:26.417422 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 536/1060] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 14 20:45:26 2022] POST /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 20:45:26.422407 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:26.423048 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:26.429988 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:26.430435 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:26.431405 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:26.432367 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:26.623341 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:26.631333 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-412a64ce-bf57-4d14-8a00-66df91f4fe46 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1515 microversion: 2.1 time: 0.212950 Jul 14 20:45:26.632645 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 525/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:26 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:27.651564 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:27.652170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:27.659847 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:27.660387 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:27.661568 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:27.662000 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:27.869382 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:27.877175 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-1b285e1f-5ecc-4e41-861a-e532ce565390 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1517 microversion: 2.1 time: 0.230828 Jul 14 20:45:27.877757 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 537/1062] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:27 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:45:28.896343 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:28.896975 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:28.904038 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:28.904497 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:28.905281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:28.905719 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:29.195134 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [req-a174f592-191e-4d40-b2d2-9cc35ac23df8 req-a11f9926-8cf8-4ece-b1fc-bfddba47501d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61a7eb-3c48-4e25-91b7-93ba228b1082", "name": "network-vif-unplugged", "status": "completed", "tag": "da21b590-1f64-4742-b37a-d9aa9698c268"}]} {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:45:29.203406 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a174f592-191e-4d40-b2d2-9cc35ac23df8 req-a11f9926-8cf8-4ece-b1fc-bfddba47501d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:29.203858 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [req-a174f592-191e-4d40-b2d2-9cc35ac23df8 req-a11f9926-8cf8-4ece-b1fc-bfddba47501d service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:29.215566 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.compute.server_external_events [req-a174f592-191e-4d40-b2d2-9cc35ac23df8 req-a11f9926-8cf8-4ece-b1fc-bfddba47501d service nova] Creating event network-vif-unplugged:da21b590-1f64-4742-b37a-d9aa9698c268 for instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 on hv-cinder-79987 Jul 14 20:45:29.218124 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:29.221703 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [req-a174f592-191e-4d40-b2d2-9cc35ac23df8 req-a11f9926-8cf8-4ece-b1fc-bfddba47501d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175187 Jul 14 20:45:29.222565 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 538/1063] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:45:29.234135 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fc199f0b-2ae2-4bc3-a41a-17cef1ca24ee tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1573 microversion: 2.1 time: 0.342051 Jul 14 20:45:29.234892 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 526/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:28 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1573 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:30.256117 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:30.256918 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:30.264832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:30.265359 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:30.266232 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:30.266725 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:30.410508 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:30.419172 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-65b4678f-422a-4fe7-9424-a13b4a59cd72 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1573 microversion: 2.1 time: 0.166961 Jul 14 20:45:30.419787 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 539/1065] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:30 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:31.436857 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:31.438404 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:31.445923 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:31.446372 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:31.447412 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:31.448083 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:31.595916 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:31.603585 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-9ed278dd-4202-47c2-86a6-bf1a6d37d464 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1573 microversion: 2.1 time: 0.170702 Jul 14 20:45:31.604155 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 527/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:31 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 20:45:32.620870 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:32.621469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:32.627897 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:32.628348 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:32.629127 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:32.629566 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:32.766292 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:32.774838 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-491b6302-1784-4018-bcd4-90b4a611096e tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1573 microversion: 2.1 time: 0.157864 Jul 14 20:45:32.775468 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 540/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:32 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:33.792778 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:33.793384 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:33.800005 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:33.800452 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:33.801225 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:33.801667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:33.936909 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:33.944664 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-962f2920-6d33-40bb-bb98-ca01d5f702f0 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1573 microversion: 2.1 time: 0.155755 Jul 14 20:45:33.945224 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 528/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:33 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:34.961558 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:34.962275 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:34.969019 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:34.969471 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:34.970245 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:34.970680 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:35.105744 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:35.113562 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-31244ccb-8199-4df1-81b1-add25ff9721c tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1573 microversion: 2.1 time: 0.155889 Jul 14 20:45:35.114149 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 541/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:34 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:36.131584 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:36.132794 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:36.139418 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:36.139879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:36.140653 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:36.141093 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:36.284030 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:36.294462 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-00bea25a-e930-4ec0-9243-b98cfacac5ec tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1573 microversion: 2.1 time: 0.166787 Jul 14 20:45:36.295068 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 529/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:36 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:37.312956 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:45:37.313578 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:45:37.320832 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:37.321290 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:37.322085 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:37.322528 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:37.458371 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:45:37.466261 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-9b8913c9-c0c5-4631-be3e-189acb49d064 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1560 microversion: 2.1 time: 0.157120 Jul 14 20:45:37.466844 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 542/1071] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:45:37 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:45:39.115600 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-26e939a3-2189-40bd-96c2-ee89e90b8f06 req-fe3c42ec-bc40-4cca-b58f-9cf6e1b7c5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61a7eb-3c48-4e25-91b7-93ba228b1082", "name": "network-vif-plugged", "status": "completed", "tag": "da21b590-1f64-4742-b37a-d9aa9698c268"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:45:39.125869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-26e939a3-2189-40bd-96c2-ee89e90b8f06 req-fe3c42ec-bc40-4cca-b58f-9cf6e1b7c5bb service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:45:39.125869 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-26e939a3-2189-40bd-96c2-ee89e90b8f06 req-fe3c42ec-bc40-4cca-b58f-9cf6e1b7c5bb service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:45:39.137762 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-26e939a3-2189-40bd-96c2-ee89e90b8f06 req-fe3c42ec-bc40-4cca-b58f-9cf6e1b7c5bb service nova] Creating event network-vif-plugged:da21b590-1f64-4742-b37a-d9aa9698c268 for instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 on hv-cinder-79987 Jul 14 20:45:39.142895 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-26e939a3-2189-40bd-96c2-ee89e90b8f06 req-fe3c42ec-bc40-4cca-b58f-9cf6e1b7c5bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031075 Jul 14 20:45:39.143525 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 530/1072] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:46:28.333856 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:46:28.334591 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Thu Jul 14 20:46:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:47:10.857963 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [80582110-b83e-4e4c-9052-cd90b5eaea3e] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 20:47:10.859376 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_api:SELECT=19 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:47:10.859589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:47:10.860463 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG dbcounter [-] [124371] Writing DB stats nova_cell1:SELECT=62 {{(pid=124371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:47:10.860589 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:47:10.863941 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_api:SELECT=19 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:47:10.864657 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG dbcounter [-] [124370] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 20:47:10.868805 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:10.869264 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:10.870256 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:10.870771 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:10.900143 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Going to try to terminate instance {{(pid=124370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 20:47:11.005666 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-f7d6999d-e1c1-4b90-8cd6-67c1f67f50de tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 204 len: 0 microversion: 2.1 time: 0.150441 Jul 14 20:47:11.012074 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 543/1073] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 14 20:47:10 2022] DELETE /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 20:47:11.019119 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:47:11.019810 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:47:11.028034 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:11.028500 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:11.029958 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:11.030330 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:11.119879 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-ff94a860-ab64-4a0d-a716-9d49fb2703da req-9bc5fc9b-8abf-4d74-b2aa-d6689106ac67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a61a7eb-3c48-4e25-91b7-93ba228b1082", "tag": "da21b590-1f64-4742-b37a-d9aa9698c268"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:47:11.130971 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-ff94a860-ab64-4a0d-a716-9d49fb2703da req-9bc5fc9b-8abf-4d74-b2aa-d6689106ac67 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:11.131517 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-ff94a860-ab64-4a0d-a716-9d49fb2703da req-9bc5fc9b-8abf-4d74-b2aa-d6689106ac67 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:11.143637 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-ff94a860-ab64-4a0d-a716-9d49fb2703da req-9bc5fc9b-8abf-4d74-b2aa-d6689106ac67 service nova] Creating event network-changed:da21b590-1f64-4742-b37a-d9aa9698c268 for instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 on hv-cinder-79987 Jul 14 20:47:11.149541 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-ff94a860-ab64-4a0d-a716-9d49fb2703da req-9bc5fc9b-8abf-4d74-b2aa-d6689106ac67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293190 Jul 14 20:47:11.150474 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 531/1074] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 20:47:11.183469 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:47:11.192036 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-558935a2-ae6d-4980-a33a-a98551d95bad tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.178625 Jul 14 20:47:11.192614 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 544/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:47:11 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:47:12.211199 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:47:12.212025 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:47:12.219970 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:12.220423 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:12.221194 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:12.221627 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:12.227451 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO oslo.messaging._drivers.impl_rabbit [-] [80582110-b83e-4e4c-9052-cd90b5eaea3e] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36448. Jul 14 20:47:12.380285 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.policy [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124371) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:47:12.391928 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-fc1957ed-ddd5-4d93-b25b-04061e427e82 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1566 microversion: 2.1 time: 0.185853 Jul 14 20:47:12.392524 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 532/1076] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:47:12 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:47:13.412719 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:47:13.413427 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.compute.api [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124370) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:47:13.421170 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:13.421636 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:13.422432 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:13.422965 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG oslo_concurrency.lockutils [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:13.424738 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [req-71ac717d-43cf-47b7-939f-6fc762063351 req-93db990c-9193-4f49-91ad-7652360ad647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61a7eb-3c48-4e25-91b7-93ba228b1082", "name": "network-vif-deleted", "tag": "da21b590-1f64-4742-b37a-d9aa9698c268"}]} {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 20:47:13.435055 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-71ac717d-43cf-47b7-939f-6fc762063351 req-93db990c-9193-4f49-91ad-7652360ad647 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:13.435594 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [req-71ac717d-43cf-47b7-939f-6fc762063351 req-93db990c-9193-4f49-91ad-7652360ad647 service nova] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:13.450655 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.compute.server_external_events [req-71ac717d-43cf-47b7-939f-6fc762063351 req-93db990c-9193-4f49-91ad-7652360ad647 service nova] Creating event network-vif-deleted:da21b590-1f64-4742-b37a-d9aa9698c268 for instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 on hv-cinder-79987 Jul 14 20:47:13.456689 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [req-71ac717d-43cf-47b7-939f-6fc762063351 req-93db990c-9193-4f49-91ad-7652360ad647 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036532 Jul 14 20:47:13.458109 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 533/1077] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 14 20:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 20:47:13.503627 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.policy [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d43152eeb9485e9ff16f38aa63ac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ded6a71283444e892094501f29e4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124370) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 20:47:13.512289 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-4868ea05-7e3d-486f-8eb0-325cc9eaf261 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 200 len: 1381 microversion: 2.1 time: 0.105163 Jul 14 20:47:13.513105 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 545/1078] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:47:13 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 1381 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 20:47:14.532098 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '>' {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:47:14.532820 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.compute.api [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] [instance: 2a61a7eb-3c48-4e25-91b7-93ba228b1082] Fetching instance by UUID {{(pid=124371) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 20:47:14.539106 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:14.539557 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:14.540322 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 20:47:14.540758 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG oslo_concurrency.lockutils [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Lock "5e48e7cb-a586-40dc-b694-2536a52d42ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 20:47:14.555992 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.wsgi [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] HTTP exception thrown: Instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 could not be found. Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Request method failure captured: Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: request: GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 HTTP/1.1 Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept: application/json Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Accept-Encoding: identity Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Connection: close Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Length: 0 Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Content-Type: application/json Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Host: 10.222.0.52 Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Openstack-System-Scope: None Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: User-Agent: python-urllib3/1.26.9 Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Auth-Token: gAAAAABi0H-gjrWoKMkjudwUy1WzCH9CSz8txXAekj6TG1sX3Dng-QvLipNP5yv5YwDFVthR-5OASzbPZL6lmjMNdpfnKbjeK_2_trH08QvL0J6Jp_5VvGobmclipnPcpFBLA9pRBLesqSLOyndUCeoyvb0NftCWb6pxIWfgISnbFVeFfPqqUok Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Id: None Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Domain-Name: None Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Identity-Status: Confirmed Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Is-Admin-Project: True Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Id: default Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Domain-Name: Default Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Id: c8ded6a71283444e892094501f29e4da Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Project-Name: tempest-TestShelveInstance-893605153 Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Role: reader,member Jul 14 20:47:14.557732 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Roles: reader,member Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8ded6a71283444e892094501f29e4da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8ded6a71283444e892094501f29e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8ded6a71283444e892094501f29e4da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8ded6a71283444e892094501f29e4da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}] Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant: tempest-TestShelveInstance-893605153 Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Id: c8ded6a71283444e892094501f29e4da Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-Tenant-Name: tempest-TestShelveInstance-893605153 Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User: tempest-TestShelveInstance-893605153-project Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Id: default Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Domain-Name: Default Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Id: c0d43152eeb9485e9ff16f38aa63ac22 Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: X-User-Name: tempest-TestShelveInstance-893605153-project Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: method: > Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: exception: Instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 could not be found. Jul 14 20:47:14.559464 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: action_args: {'id': '2a61a7eb-3c48-4e25-91b7-93ba228b1082'} Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: {{(pid=124371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 could not be found. Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 20:47:14.560344 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 could not be found. Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 could not be found. Jul 14 20:47:14.562108 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: ERROR nova.api.openstack.wsgi Jul 14 20:47:14.563667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: DEBUG nova.api.openstack.wsgi [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Returning 404 to user: Instance 2a61a7eb-3c48-4e25-91b7-93ba228b1082 could not be found. {{(pid=124371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 20:47:14.563667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO nova.api.openstack.requestlog [None req-c3d8e225-7453-49f8-b1d6-ea3434bf2fbd tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082" status: 404 len: 111 microversion: 2.1 time: 0.033008 Jul 14 20:47:14.563667 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: [pid: 124371|app: 0|req: 534/1079] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 14 20:47:14 2022] GET /compute/v2.1/servers/2a61a7eb-3c48-4e25-91b7-93ba228b1082 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 20:47:14.740987 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: DEBUG nova.api.openstack.wsgi [None req-882aaad5-42fd-428b-b417-d97d23279060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] Calling method '.version_select at 0x7fafb1ad40d0>' {{(pid=124370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 20:47:14.760728 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO nova.api.openstack.requestlog [None req-882aaad5-42fd-428b-b417-d97d23279060 tempest-TestShelveInstance-893605153 tempest-TestShelveInstance-893605153-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-178469649" status: 202 len: 0 microversion: 2.1 time: 0.023507 Jul 14 20:47:14.773969 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: [pid: 124370|app: 0|req: 546/1080] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 14 20:47:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-178469649 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 20:48:08.180638 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:48:08.181352 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Thu Jul 14 20:48:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:48:13.208666 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:48:13.209281 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Thu Jul 14 20:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:49:41.657546 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:49:41.658030 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Thu Jul 14 20:49:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:49:48.342148 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:49:48.342668 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Thu Jul 14 20:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:50:06.515555 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:50:06.516131 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Thu Jul 14 20:50:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:50:18.665871 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:50:18.666354 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Thu Jul 14 20:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:51:28.189245 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:51:28.189952 dv-cinder-799871-32-iscsi devstack@n-api.service[124370]: Thu Jul 14 20:51:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 20:51:33.217099 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 20:51:33.217726 dv-cinder-799871-32-iscsi devstack@n-api.service[124371]: Thu Jul 14 20:51:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!